Test Custom Kafka Collector

Describes, how to test custom kafka based collectors

Follow the procedure to test the existing sample kafka based examples.

1. Move examples/kafka_custom_collector directory to base directory collector-sdk and remove configuration directory under kafka_custom_collector.

2. Modify the configuration files config.json, metadata.json and build_config.json as per your requirement.

3. Later, package can be created and uploaded using build.sh command.

To test the kafka collector, use command:

python3 app.py --directory <directory name where the collector is created> --test --configfile config.json --configschema config_input_schema.json

You can check the output which will be published to kafka further, in output.json under base directory And also the logs are written in logs/logs.txt.