Instaclustr Managed Apache Kafka Connect SLA sink plugin
This plugin’s purpose is to generate a latency value per each record it receives from the configured topics and write it out to a file in milliseconds.
Example output in a file:
12
34
54
12
…..
You can use this output to get a view of how much latency exists from when a message was produced to the point at which it was processed by the connector task, using the Kafka record timestamp (assuming it was not manually set and is configured to CreateTime).
Configurations Available
- “topics” : the topics that are being consumed from
- “tasks.max” :the number of tasks
- “file” : the output file the latencies are written to
Example Connector Creation Request
|
1 2 3 4 5 6 7 8 9 10 |
curl https://<WORKER_IP>:<port>/connectors -X POST -H 'Content-Type: application/json' -d ' { "name":"sla-example", "config":{ "connector.class":"com.instaclustr.kafka.connect.sla.SlaSinkConnector", "tasks.max":"3", "file":"<file-path-and-name>", "topics":"<topic-1, ...>" } }' -k -u <YOUR_USER>:<YOUR_PASSWORD> |
By Instaclustr Support
Need Support?
Experiencing difficulties on the website or console?
Already have an account?
Need help with your cluster?
Contact Support
Why sign up?