To collect the data from the various data sources, you can add Kafka mapping. Kafka mapping also helps in processing incoming records. Additionally to map the properties, you can use JSON path expressions.

Procedure

  1. Go to https://Telcocloud serviceassurance-ui-IP.
    A typical URL for logging into the user interface from the same system on which VMware Telco Cloud Service Assurance is installed is https://10.x.x.x.
  2. Enter the user name and password.
  3. Click Next.
  4. Navigate to the Administration > Configuration.
  5. Click Kafka Mappers.
    Add Kafka Mapper appears in the right pane.
    You can evaluate your Kafka Mapping by uploading sample data in Sample data tab, and click Evaluate tab to see how processed data looks like. Sample data now accepts three types of data types:
    • JSON: If you have your data in JSON format, you can directly upload and use evaluate functionality.
    • MnR: If you have your data in MnR type you can select sample data type as MnR and upload MnR file, it gets converted into JSON format and then you can use Evaluate option.
    • Avro: In sample data for Avro data type, you can upload your Avro schema and Avro binary data, it gets converted into JSON and then you can click Evaluate. The evaluate tab contains the processed data or error based on the current Kafka Mapper, and converted Avro JSON sample data in the code window.
  6. To configure the Kafka mapping, enter the details as listed below:
    Input Parameters Description Default Value
    Mapper Name Provide name of the mapping. NA
    Mapper Description Provide description about Kafka mapping. NA
    Type Select from following:
    • Metrics
    • Events
    		 Metrics
    Mapping Details
    Replace Mapping Schema Upload a new mapping schema. NA
    Target Data Model Provide details about selected model schema:
    • Catalog
    • Data Model
    • Properties
    • Tags
    		 NA
    Model Type Use Choose Model, to select the model from the Data Model Catalogs. Generic
    Sample Data Type Select Sample Data Type, from the dropdown:
    • JSON
    • MnR
    • Avro
    		 NA
    Sample Data

    Mapping source properties to the destination properties to comply with the VMware Telco Cloud Service Assurance format using JSONPath expressions.

    Example:
     "type": "Kafka-Collector",
 "instance": "$.properties.source",
 "timestamp": "$.timestamp",
 "metricType": "$.properties.devtype",
 "properties.dataSource": "$.properties.ip",
 "properties.deviceType": "$.properties.devtype",
 "properties.deviceName": "$.properties.devdesc",
 "properties.entityType": "$.properties.type",
 "properties.entityName": "$.properties.table",
    Note: For Avro files, you need to upload schema and binary file through Choose Schema and Choose Avro button repectively.
    		NA
    Evaluate Provides JSON path expression mapping values to the sample data. NA
  7. To create Kafka mapping, click Create Mapper.