Monitoring VMware Private AI Foundation with NVIDIA

You can monitor GPU metrics at the cluster and host level in the vSphere Client and VMware Aria Operations.

In VMware Aria Operations, you can monitor GPU metrics at the cluster, host system and host properties levels. For more information, see Private AI (GPU) Dashboards and Properties for vCenter Server Components in VMware Aria Operations.

In the vSphere Client, you can monitor GPU metrics in the following way:

• At the host level. See Hosts Performance Charts in vSphere.
• At the cluster level in custom charts. See Working with Advanced and Custom Charts in vSphere.