Beeks Analytics for Markets Configuration Template
Beeks Analytics for Markets uses certain abstracted higher-level configuration concepts to drive the creation of the lower-level configuration of the VMX-Capture and VMX-Analysis components.
For further details of the lower-level configurations that are possible in VMX-Capture and VMX-Analysis as part of Beeks Analytics Enterprise deployments, see the Beeks Analytics Configuration Guide.
Visibility Points
As mentioned in How is data captured? , Beeks Analytics for Markets has the concept of one or more Visibility Points. These are the points in your network at which traffic is observed and captured.
By providing a consistent framework that enables us to understand where in the network a particular analytics metric is recorded, we can reliably organise conversation endpoints into either an Internal Group or an External Group.
Grouping Conversation endpoints into Internal Groups and External Groups
The benefit of this kind of grouping is that is provides an easy reference point for understanding multiple wiretime metrics.
To take an example, consider the following set of metrics:
Metric | Direction | Measurement |
---|---|---|
IP Microburst | Inbound from External Group A (e.g. a particular feed). | Unexpectedly high at 1330 GMT last Friday (US Market Open). |
Market Data Latency | Inbound from External Group A (e.g. a particular feed). | Unexpectedly high at 1330 GMT last Friday (US Market Open). |
TCP Loss | Inbound to a particular Internal Group (e.g. Dedicated Server 1). | Some loss starts to appear from 1330 GMT last Friday (US Market Open) |
TCP Loss | Outbound from a particular Internal Group (e.g. a Dedicated Server 1). | Some loss starts to appear from 1330 GMT last Friday (US Market Open). |
You might conclude that the volume of data from External Group A causes the loss to occur, perhaps by overwhelming the network connection of that particular Dedicated Server for a period of time.
The Beeks Analytics for Markets templated deployment makes monitoring easy for the user by:
Automatically differentiating between ‘Internal’ and ‘External’ traffic,
Allowing the Analytics user to group multiple physical cross-connect ports together into a single monitored connection - which we call an External Group. The client can give this External Group a friendly name so that they know what data they are looking at in the analytics system. So, for example, the External Group for VenueA may comprise of one physical Cross Connect to VenueA on the A-switch, and one physical Cross Connect to VenueB on the B-switch. Combining these into a single External Group simplifies fault finding.
Internal Groups and Internal Entities
A ‘group’ is just a collection of one or more IP addresses or network ranges. In this document, we typically refer to External Groups and Internal Entities, as often the internal entities are well understood and it is confusing to think of them as ‘groups’.
In a Proximity Cloud or Exchange Cloud deployment, each Internal Entity will be an individual Dedicated Server.
Switchport and IP Address Details for Internal and External Groups
Each Internal Group or External Group will be defined by one or more switchports, and each switchport has an IP address or IP network associated. Virtual (e.g. bonded, NAT IP addresses presented by network devices) interfaces can be defined as well as physical switchports.
The switchport aggregator level is useful if you want to synthetically create ‘per port’ traffic statistics from the data collected by Beeks Analytics (for example, where an external venue publishes multicast market data to you over multiple switchports, and you want to traffic the multicast statistics for each port independently). Where it isn’t important to collect this information, the switchport is normally recorded as ‘multi’, but other designations can be used in the configuration to assist with grouping Internal Entities or External Groups in different ways.
Beeks Analytics for Markets can breakdown traffic per switchport if these are defined correctly in the configuration.
External Group Details
In addition to the switchport and IP address/network details above, switchports for External Groups can have other information configured for them:
Multicast IPs. These are defined by IP address. These allow extra UDP statistics to be calculated for each of these IP addresses. Not needed where the multicast address is part of a multicast data feed (see below).
TCP Gateways. These are defined by IP address and by TCP ports/port ranges. These allow extra TCP statistics to be calculated for each of the gateways that are defined in this way.
Trading Gateways. These are defined by IP address and by optional TCP ports/port ranges. A Trading Gateway will have decodable messages which will allow App-to-Wire latency and Order Latency calculations to be performed for it, in addition to the underlying TCP and IP metrics.
Feeds. These are multicast market data feeds. A multicast feed will have decodable messages which will allow App-to-Wire latency and gap detection calculations to be performed for it, in addition to the underlying UDP and IP metrics.
About the Tx and Rx directions
With the Beeks Analytics for Markets template, Tx messages are sent from an Internal Entity to an External Entity. Rx messages are sent from an External Entity to an Internal Entity.
Note that, with Beeks Analytics for Markets, an important assumption is made that multicast data is received from External Groups, and is not published to them (or, if it is, that monitoring that traffic is not important). As a result, UDP metrics are only recorded in one direction - received (i.e. Rx) from External Groups.
Multicast traffic that is published internally can be analysed with Beeks Analytics for Markets, but details will vary depending on your configuration.