After upgrading from version 2.3.1 or 2.3 to version 2.4 if the Notification, Topology, or Metric data are not getting updated in the user interface even after restarting the collectors then follow the steps.

Solution

  1. Verify whether the Topology, Notification, and Metric data are been collected by running the following command from the deployer VM by restarting the Notification Collector, Metric Collector and Topology Collector:
    kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_events_raw
    kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_topo_raw
    kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_metric_raw
  2. If the above command shows that the data been collected, then run the below command to verify if the collected data is getting enriched:
    kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_events
    kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_topo
    kubectl exec -n tps-system internal-kafka-0 -- bin/kafka-console-consumer.sh --bootstrap-server internal-kafka-bootstrap:9092 --topic vsa_metric
  3. If the above commands output, indicate that no data is been enriched, then run the following workaround steps:
    1. Delete the spe-api pod by running the below command:
      [root@dhcp-10-80-84-84 ~]# kubectl get pod -A | grep spe-api
      tcsa-system         spe-api-7cbd476b7c-r6c9v                               1/1     Running     1 (38h ago)    41h
      [root@dhcp-10-80-84-84 ~]# kubectl delete pod -n tcsa-system <spe-api pod> 
    2. Delete the Enrichment pod by running the below command:
      [root@dhcp-10-80-84-84 ~]# kubectl get pod -A | grep enrichment
      tcsa-system         enrichment-66fc5456f5-nklfd                            1/1     Running     0              41h
      tcsa-system         enrichment-66fc5456f5-rxpwt                            1/1     Running     0              41h
      [root@dhcp-10-80-84-84 ~]# kubectl delete pod -n tcsa-system <enrichment pod>