In VMware Private AI Foundation with NVIDIA, as a DevOps engineer, by using the Kubernetes API, you provision a TKG cluster that uses NVIDIA GPUs. Then, you can deploy container AI workloads from the NVIDIA NGC catalog.

You use kubectl to deploy the TKG cluster on the namespace configured by the cloud administrator.

Prerequisites

Verify with the cloud administrator that the following prerequisites are in place for the AI-ready infrastructure.

Procedure

  1. Log in to the Supervisor control plane.
    kubectl vsphere login --server=SUPERVISOR-CONTROL-PLANE-IP-ADDRESS-or-FQDN --vsphere-username USERNAME
  2. Provision a TKG cluster and install the NVIDIA GPU Operator and NVIDIA Network Operator on it.

What to do next

Deploy an AI container image from the NVIDIA NGC catalog.