After upgrading from version 2.3.1 or 2.3 to version 2.4 if the Notification, Topology, or Metric data are not getting updated in the user interface even after restarting the collectors then follow the steps.
Solution
- Verify whether the Topology, Notification, and Metric data are been collected by running the following command from the deployer VM by restarting the Notification Collector, Metric Collector and Topology Collector:
kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_events_raw kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_topo_raw kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_metric_raw
- If the above command shows that the data been collected, then run the below command to verify if the collected data is getting enriched:
kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_events kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_topo kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_metric
- If the above commands output, indicate that no data is been enriched, then run the following workaround steps:
- Delete the spe-api pod by running the below command:
[root@dhcp-10-80-84-84 ~]# kubectl get pod -A | grep spe-api tcsa-system spe-api-7cbd476b7c-r6c9v 1/1 Running 1 (38h ago) 41h [root@dhcp-10-80-84-84 ~]# kubectl delete pod -n tcsa-system <spe-api pod>
- Delete the Enrichment pod by running the below command:
[root@dhcp-10-80-84-84 ~]# kubectl get pod -A | grep enrichment tcsa-system enrichment-66fc5456f5-nklfd 1/1 Running 0 41h tcsa-system enrichment-66fc5456f5-rxpwt 1/1 Running 0 41h [root@dhcp-10-80-84-84 ~]# kubectl delete pod -n tcsa-system <enrichment pod>
- Delete the spe-api pod by running the below command: