Kafka Mapper is one more option available in VMware Telco Cloud Service Assurance that helps you to bring data into the system for further analysis.
It connects to the source Kafka broker and tap data from a given topic, extract and transform data into the VMware Telco Cloud Service Assurance object model, and then store it in VMware Telco Cloud Service Assurance
The Kafka Mapper approach consists in:
- Consuming JSON and M&R data from the user Kafka topic (M&R data is converted into JSON, before processing further).
- Converting data to VMware Telco Cloud Service Assurance object model.
- Processing data based on user-defined mapping to VMware Telco Cloud Service Assurance defined JSON format.
- Performing validation and send processed records to the internal VMware Telco Cloud Service Assurance Kafka for further consumption (For example: Reporting).
Mapping
In order to comply with VMware Telco Cloud Service Assurance data model, you must inform a mapping that will be used to process incoming records. Properties can be mapped using JSON Path expressions.
JSON Path Operators
Following is the list of supported operators:
| Operators | Description |
|---|---|
| == | left is equal to right (note that 1 is not equal to '1') |
| != | left is not equal to right |
| < | left is less than right |
| <= | left is less or equal to right |
| > | left is greater than right |
| >= | left is greater than or equal to right |
| =~ | left matches regular expression [?(@.name =~ /foo.*?/i)] |
| in | left exists in right [?(@.size in ['S', 'M'])] |
| nin | left does not exists in right |
| subsetof | left is a subset of right [?(@.sizes subsetof ['S', 'M', 'L'])] |
| anyof | left has an intersection with right [?(@.sizes anyof ['M', 'L'])] |
| noneof | left has no intersection with right [?(@.sizes noneof ['M', 'L'])] |
| size | size of left (array or string) should match right |
| empty | left (array or string) should be empty |
