This section is designed to help you troubleshoot issues that relate to the Core Data Feed.

Many dropped or delayed messages

The Core Data Feed has been designed to handle large volumes of data.  Given a reliable connection and enough processing power, it will send 100% of messages. However, if it detects any kind of problem in processing or transmitting events, then it will drop messages to protect itself.

Dropped or delayed messages could be caused by:

  • Connectivity issues
    Check firewall settings.
    Check if there is network congestion.
    Check if there’s a hardware failure.

  • Misconfigured Topic
    Ensure that your Kafka Topic has sufficient partitions.

You should also consider:

  • Filtering messages to reduce volume.

  • Parallel message processing.

  • Optimising your message processing threads.

  • Server CPU starvation when processing events to be sent.  If your CDF-I output is suffering from drops or delays and the exhaust Core Data Feed server processing threads is running at 100%, you can add more threads by setting:
    vmx.exhaustProcessor.queuingExhaustProcessor.totalThreads

You can find out more information about filtering messages and how to introduce further parallelization in the Analytics Configuration Guide (BKDA008) and Configuration Guide for VMX-Capture (BKDA013).

Kafka doesn’t receive messages from CDF

The following could prevent messages from passing from the Core Data Feed to Kafka:

  • Authentication/authorisation failure
    Check Beeks Analytics is authorised to publish to a Topic.
    Check that the broker is configured to authenticate Beeks Analytics.

  • Resourcing issues
    Ensure the broker has sufficient resources (memory or disk space).

  • Timeouts
    Ensure there is no long delay between sending and receiving messages.

  • Cluster Failure
    Ensure there is no failure in one or more brokers in the cluster.

Analytics Server doesn’t start

  • The server will not start if it is configured to send Core Data Feed messages, but not licensed. Check your licence is valid.

VMX-AdminConsole doesn’t show Core Data Feed fields

  • The CDF is enabled and configured via the VMX-AdminConsole. The CDF fields in the VMX-AdminConsole are enabled by a licence. Check your licence is valid.