The VMware Deep Learning VM images are delivered as part of VMware Private AI Foundation with NVIDIA. They are preconfigured with popular ML workloads, and are optimized and validated by NVIDIA and VMware for GPU acceleration in a VMware Cloud Foundation environment.

VMware Deep Learning VM 1.0 | 26 MAR 2024

Check for additions and updates to these release notes.

Content Library

Deep learning VM images are delivered as vSphere VM templates, hosted and published by VMware in a content library. You can use these images to deploy Deep learning VM by using the vSphere Client or VMware Aria Automation.

The content library with deep learning VM images for VMware Private AI Foundation with NVIDIA is available at the https://packages.vmware.com/dl-vm/lib.json URL. In a connected environment, you create a subscribed content library connected to this URL, and in a disconnected environment - a local content library where you upload images from the central content library.

Compatibility and Upgrade

Use the latest release of VMware Deep Learning VM if supported by your environment.

Updating a running deep learning VM to a later image is not supported. You must deploy a new deep learning virtual machine by using a later deep learning VM image release.

Installation

You deploy a deep learning VM image from a content library on the vCenter Server instance for the AI-ready VI workload domain. You can deploy a deep learning VM on the following systems:

  • Directly on a vSphere cluster

  • On a Supervisor in vSphere with Tanzu by using the vSphere Client and kubectl or by using VMware Aria Automation.

See Deploying a Deep Learning VM in VMware Private AI Foundation with NVIDIA.

VMware Deep Learning VM 1.0

Image Snapshot

VMware Deep Learning VM 1.0 is available for use with VMware Cloud Foundation 5.1.1.

Snapshot

Release Date

Compatible VMware Cloud Foundation Version

common-container-nv-vgpu-ubuntu-2204-v20240217

26 MAR 2024

VMware Cloud Foundation 5.1.1

Supported NVIDIA GPU Devices

VMware Deep Learning VM 1.0 supports the following GPUs on your ESXi hosts:

NVIDIA Component

Supported Option

NVIDIA GPUs

  • NVIDIA A100

  • NVIDIA L40S

  • NVIDIA H100

GPU sharing mode

  • Time slicing

  • Multi-Instance GPU

Compatible VMware Cloud Foundation Versions

The VMware Deep Learning VM 1.0 release is compatible with VMware Cloud Foundation 5.1.1.

Components of VMware Deep Learning VM 1.0

The initial version of the deep learning virtual machine image contains the following software:

Software Component Category

Software Component

Version

Embedded

Canonical Ubuntu

22.04

NVIDIA Container Toolkit

1.13.5

Docker Community Engine

25.03

Can be pre-installed automatically

NVIDIA vGPU guest driver

According to the version of the NVIDIA vGPU host driver

Deep learning (DL) workload from NVIDIA NGC

CUDA Sample

-

PyTorch

-

TensorFlow

-

DCGM Exporter

-

Triton Inference Server

-

NVIDIA RAG

-

License Information

VMware Deep Learning VM releases are available under a VMware Private AI Foundation with NVIDIA license. See VMware Private AI Foundation with NVIDIA Guide.

Documentation

Examine the VMware Private AI Foundation with NVIDIA Guide for an overview and how-to instructions for running deep learning VMs in a VMware Cloud Foundation environment.

check-circle-line exclamation-circle-line close-line
Scroll to top icon