Monitoring of External Airflow Metrics Over StatsD

For monitoring the external Airflow metrics, the VMware Telco Cloud Service Assurance must be deployed in the same Kubernetes cluster as Airflow.

After the service is deployed on Kubernetes, perform the following configuration changes in the Airflow. Add the following codeblock into the cfg file.

[metrics]
statsd_on = True
statsd_host = servicelabel_of_the_deployment
statsd_port = 8125
statsd_prefix = airflow

If the deployment does not use a .cfg file, the same can be achieved by setting the ENV variables.

AIRFLOW__METRICS__STATSD_ON
AIRFLOW__METRICS__STATSD_HOST
AIRFLOW__METRICS__STATSD_PORT
AIRFLOW__METRICS__STATSD_PREFIX

For information on metrics, see External Airflow Service Metrics.