Configuration

SP related configuration files can be located in following directories:

<DCF-Install>/Collecting/Collector-Manager/<SP-Instance>(velocloud-sdwan-collect)/conf/

<DCF-Install>/ Collecting /Stream-Collector/<SP-Instance>/conf/

<DCF-Install>/ Collecting /Kafka-Connector/<SP-Instance>/conf/

1. Collector Manager Configuration

   A Collecting Manager Configuration file can be found in below location :

   File: <DCF-Install>/ Collecting/Collector-Manager /<INSTANCE>(velocloud-sdwan-collect)/conf/collecting.xml

   Sample contents:

   <?xml version="1.0" encoding="UTF-8"?>
   <config xmlns="http://www.watch4net.com/APG/Collecting" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
           xsi:schemaLocation="http://www.watch4net.com/APG/Collecting collecting.xsd ">
                           <runOnce>true</runOnce>
       <connectors>
           <connector enabled="false" name="File" type="File-Connector"  config="Collector-Manager/velocloud-sdwan-collect/conf/file-connector.xml" />
           <connector enabled="true" name="Kafka" type="Kafka-Connector" config="Kafka-Connector/velocloud-sdwan-collect/conf/kafka-connector.xml" />
       </connectors>
       <filters>
       </filters>
           <collectors>
           <collector enabled="true" name="VCODiscover" next="File Kafka" config="Stream-Collector/velocloud-sdwan-collect/velo/conf/discovery-velocloud.xml" />
            </collectors>
   </config>
   

   This is basic configuration of the SP which deals with how the processing should start.

2. Getting configuration from the collector using REST API

   1. Config: The configuration for the collector block can be obtained using the following GET REST request:

      URL: GET: https://{{host}}:{{port}}/dcc/v1/catalog/blocks/{{block-name}}/config/get

   2. Default Config: The default configuration for the collector block can be obtained using the following GET REST request url: GET: https:// {{host}}:{{port}}/dcc/v1/catalog/blocks/{{block-name}}/config/default

3. Kafka Connector Configuration

   Kafka server configuration used to publish events from velocloud sdwan DCF collector to Kafka is below:

   File : <DCF-Install>/Collecting/Kafka-Connector/<INSTANCE>(velocloud-metrics-collect)/conf/kafka-connector.xml)

   <kafka-connector-config xmlns="http://www.watch4net.com/KafkaConnector" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
       xsi:schemaLocation="http://www.watch4net.com/KafkaConnector ../kafka-connector.xsd ">
           <kafka-producer-settings>
               <!-- Servers information -->
                   <server host="localhost" port="9092"/>
               <!-- Producer (and topic) information -->
               <producer topic-name="default-topic"
                   acks="1"
                   retries="0"
                   linger-ms="0ms"
                   buffer-memory="33554432"
                   compression-type="none"
                   batch-size="16384"
                   max-block-ms="5s"
                   max-in-flight-requests-per-connection="5"
                   max-request-size="1048576"/>
   
               <!-- All connection parameters will be attributes except "server" -->
               <connection request-timeout-ms="5s"
                   connections-max-idle-ms="9m"
                   retry-backoff-ms="100ms"
                   reconnect-backoff-ms="50ms"/>
   
               <!-- Additional properties -->
               <additional-parameters key="metadata.max.age.ms">1000</additional-parameters>
               <additional-parameters key="receive.buffer.bytes">32768</additional-parameters>
               <additional-parameters key="send.buffer.bytes">131072</additional-parameters>
   
           <additional-parameters key="security.protocol">SSL</additional-parameters>
               <additional-parameters key="ssl.truststore.location">../../../Tools/Webservice-Gateway/Default/conf/truststore</additional-parameters>
           <additional-parameters key="ssl.truststore.password">{613FF4F84B7A36EC8D22728760D70A56FF2CB8E9CCCD90367BFEEB74E5B97EAB1B765AA92F50F91101E757D131BD5A4D}</additional-parameters>
           <additional-parameters key="ssl.keystore.location">../../../Tools/Webservice-Gateway/Default/conf/clientkeystore</additional-parameters>
           <additional-parameters key="ssl.keystore.password">{9F9B74AF79C19897075C1CFEC22D542F018838BEFE763E4DF180850D474320D2EC9595E36F68D90A1A830175BF42D8A7}</additional-parameters>
           <additional-parameters key="ssl.key.password">{FE076F391C3C5946DF2EDF230CAF272D601423289B8BFF9C29F246D089C153D01E2E5A0B1A1F714C814DDF3088F3982F}</additional-parameters>
   
           </kafka-producer-settings>
   
           <connector-component-behavior outputJson="true" flush-every-n-rawvalues="5000"/>
   
   </kafka-connector-config>
   

   Kafka Connector parameters

   Parameters	Description
   server	This tag must occur at least once. host: The address of one of the kafka bootstrap servers port: The port that the bootstrap server is listening on.
   producer	This tag is optional, but may be used for templating kafka producers. Please refer to the schema for more information.
   connection	This tag is optional, but may be used for templating kafka connections. Please refer to the schema for more information.
   additional-parameters	This tag is optional, but may be used for configuring kafka options outside of the purview of the previous tags. These options include, but are not limited to SSL connection parameters.

   Configuring Kafka Connector:

   Parameters	Description
   kafka-producer-settings	This tag may be used if we want to customize how the writer writes to kafka. Please refer to the schema for more information.
   connector-component-behavior	This tag may be used if we want to control how often we flush to kafka.