SP related configuration files can be located in following directories:
<DCF-Install>/Collecting/Collector-Manager/<SP-Instance>(velocloud-sdwan-collect)/conf/
<DCF-Install>/ Collecting /Stream-Collector/<SP-Instance>/conf/
<DCF-Install>/ Collecting /Kafka-Connector/<SP-Instance>/conf/
-
Collector Manager Configuration
A Collecting Manager Configuration file can be found in below location :
File: <DCF-Install>/ Collecting/Collector-Manager /<INSTANCE>(velocloud-sdwan-collect)/conf/collecting.xml
Sample contents:<?xml version="1.0" encoding="UTF-8"?> <config xmlns="http://www.watch4net.com/APG/Collecting" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.watch4net.com/APG/Collecting collecting.xsd "> <runOnce>true</runOnce> <connectors> <connector enabled="false" name="File" type="File-Connector" config="Collector-Manager/velocloud-sdwan-collect/conf/file-connector.xml" /> <connector enabled="true" name="Kafka" type="Kafka-Connector" config="Kafka-Connector/velocloud-sdwan-collect/conf/kafka-connector.xml" /> </connectors> <filters> </filters> <collectors> <collector enabled="true" name="VCODiscover" next="File Kafka" config="Stream-Collector/velocloud-sdwan-collect/velo/conf/discovery-velocloud.xml" /> </collectors> </config>
This is basic configuration of the SP which deals with how the processing should start.
- Getting configuration from the collector using REST API
-
Config: The configuration for the collector block can be obtained using the following GET REST request:
URL: GET: https://{{host}}:{{port}}/dcc/v1/catalog/blocks/{{block-name}}/config/get
-
Default Config: The default configuration for the collector block can be obtained using the following GET REST request url: GET: https:// {{host}}:{{port}}/dcc/v1/catalog/blocks/{{block-name}}/config/default
-
-
Kafka Connector Configuration
Kafka server configuration used to publish events from velocloud sdwan DCF collector to Kafka is below:
File : <DCF-Install>/Collecting/Kafka-Connector/<INSTANCE>(velocloud-metrics-collect)/conf/kafka-connector.xml)<kafka-connector-config xmlns="http://www.watch4net.com/KafkaConnector" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.watch4net.com/KafkaConnector ../kafka-connector.xsd "> <kafka-producer-settings> <!-- Servers information --> <server host="localhost" port="9092"/> <!-- Producer (and topic) information --> <producer topic-name="default-topic" acks="1" retries="0" linger-ms="0ms" buffer-memory="33554432" compression-type="none" batch-size="16384" max-block-ms="5s" max-in-flight-requests-per-connection="5" max-request-size="1048576"/> <!-- All connection parameters will be attributes except "server" --> <connection request-timeout-ms="5s" connections-max-idle-ms="9m" retry-backoff-ms="100ms" reconnect-backoff-ms="50ms"/> <!-- Additional properties --> <additional-parameters key="metadata.max.age.ms">1000</additional-parameters> <additional-parameters key="receive.buffer.bytes">32768</additional-parameters> <additional-parameters key="send.buffer.bytes">131072</additional-parameters> <additional-parameters key="security.protocol">SSL</additional-parameters> <additional-parameters key="ssl.truststore.location">../../../Tools/Webservice-Gateway/Default/conf/truststore</additional-parameters> <additional-parameters key="ssl.truststore.password">{613FF4F84B7A36EC8D22728760D70A56FF2CB8E9CCCD90367BFEEB74E5B97EAB1B765AA92F50F91101E757D131BD5A4D}</additional-parameters> <additional-parameters key="ssl.keystore.location">../../../Tools/Webservice-Gateway/Default/conf/clientkeystore</additional-parameters> <additional-parameters key="ssl.keystore.password">{9F9B74AF79C19897075C1CFEC22D542F018838BEFE763E4DF180850D474320D2EC9595E36F68D90A1A830175BF42D8A7}</additional-parameters> <additional-parameters key="ssl.key.password">{FE076F391C3C5946DF2EDF230CAF272D601423289B8BFF9C29F246D089C153D01E2E5A0B1A1F714C814DDF3088F3982F}</additional-parameters> </kafka-producer-settings> <connector-component-behavior outputJson="true" flush-every-n-rawvalues="5000"/> </kafka-connector-config>
Kafka Connector parametersParameters
Description
server
This tag must occur at least once.
host: The address of one of the kafka bootstrap servers
port: The port that the bootstrap server is listening on.
producer
This tag is optional, but may be used for templating kafka producers. Please refer to the schema for more information.
connection
This tag is optional, but may be used for templating kafka connections. Please refer to the schema for more information.
additional-parameters
This tag is optional, but may be used for configuring kafka options outside of the purview of the previous tags. These options include, but are not limited to SSL connection parameters.
Configuring Kafka Connector:Parameters
Description
kafka-producer-settings
This tag may be used if we want to customize how the writer writes to kafka. Please refer to the schema for more information.
connector-component-behavior
This tag may be used if we want to control how often we flush to kafka.