The VMware Private AI Foundation with NVIDIA Guide provides an overview of the components of VMware Private AI Foundation with NVIDIA and high-level workflows for development and production use cases.
Intended Audience
The information in VMware Private AI Foundation with NVIDIA Guide is intended for data center cloud administrators, data scientists, MLOps engineers, and DevOps engineers who are familiar with:
- Cloud administrators
- Concepts of virtualization and software-defined data centers (SDDCs)
- Hardware components such as top-of-rack (ToR) switches, inter-rack switches, servers with direct attached storage, cables, and power supplies
- Methods for setting up NVIDIA GPUs on servers in a data center
- Using VMware vSphere® to work with virtual machines.
- Using vSphere IaaS control plane to configure and assign vSphere resources to vSphere namespaces on a Supervisor.
As a cloud administrator, see the following information:
- Data scientists, AI application developers, or MLOps engineers
- Containers, including Docker, Helm charts and Harbor Registry
As a data scientist or AI application developer, see the following information:
- Deploying a Deep Learning VM in VMware Private AI Foundation with NVIDIA
- Deploying RAG Workloads in VMware Private AI Foundation with NVIDIA
As an MLOps engineer, see the following information:
- DevOps engineers
- Provisioning virtual machines in vSphere using the Kubernetes API.
- Containers, including Docker, Helm charts and Harbor Registry
- Working with vSphere IaaS control plane for provisioning VMs and Tanzu Kubernetes Grid (TKG) clusters.
As a DevOps engineer, see the following information:
VMware Software Components
The functionality of the VMware Private AI Foundation with NVIDIA solution is available across several software components according to your role in your organization.
| Target User Role | Software Category | Supported Software Versions |
|---|---|---|
| Cloud administrators | Components that are deployed in VMware Cloud Foundation | See the following information: |
| Data scientists, AI application developers, MLOps engineers | Deep learning VM components | See VMware Deep Learning VM Release Notes. |
| DevOps engineers | TK releases (TKr) | See VMware Tanzu Kuberenetes releases Release Notes. |
Related VMware Documentation
The VMware Private AI Foundation with NVIDIA solution includes a stack of VMware software components that are part of VMware Cloud Foundation. The documentation for those software components is as follows:
VMware Cloud Foundation Glossary
The VMware Cloud Foundation Glossary defines terms specific to VMware Cloud Foundation.
