Test Custom Kafka Avro Collector

Describes, how to test custom kafka-based avro collectors.

Follow the procedure to test the existing sample kafka based avro examples.

1. Move  examples/kafka_avro_custom_collector directory to the base directory collector-sdk and remove the configuration directory under kafka_avro_custom_collector.

2. Modify the configuration files config.json, metadata.json, and build_config.json as per your requirement.

3. Later, the package can be created and uploaded using build.sh command.

To test the kafka avro custom collector, use the command:

python3 app.py --directory <directory name where the collector is created> --test --configfile config.json --configschema config_input_schema.json

You can check the output which will be published to kafka further, in output.json under base directory And also the logs are written in logs/logs.txt.