The VMware Deep Learning VM images are delivered as part of VMware Private AI Foundation with NVIDIA. They are preconfigured with popular ML workloads, and are optimized and validated by NVIDIA and VMware for GPU acceleration in a VMware Cloud Foundation environment.

VMware Deep Learning VM 1.0.1 | 06 May 2024

Check for additions and updates to these release notes.

Content Library

Deep learning VM images are delivered as vSphere VM templates, hosted and published by VMware in a content library. You can use these images to deploy Deep learning VM by using the vSphere Client or VMware Aria Automation.

The content library with deep learning VM images for VMware Private AI Foundation with NVIDIA is available at the https://packages.vmware.com/dl-vm/lib.json URL. In a connected environment, you create a subscribed content library connected to this URL, and in a disconnected environment - a local content library where you upload images from the central content library.

Compatibility and Upgrade

Use the latest release of VMware Deep Learning VM if supported by your environment.

Updating a running deep learning VM to a later image is not supported. You must deploy a new deep learning virtual machine by using a later deep learning VM image release.

Installation

You deploy a deep learning VM image from a content library on the vCenter Server instance for the AI-ready VI workload domain. You can deploy a deep learning VM on the following systems:

  • Directly on a vSphere cluster

  • On a Supervisor in vSphere with Tanzu by using the vSphere Client and kubectl or by using VMware Aria Automation.

See Deploying a Deep Learning VM in VMware Private AI Foundation with NVIDIA.

VMware Deep Learning VM 1.0.1

Image Snapshot

VMware Deep Learning VM 1.0.1 is available for use with VMware Cloud Foundation 5.1.1.

Snapshot

Release Date

Compatible VMware Cloud Foundation Version

common-container-nv-vgpu-ubuntu-2204-v20240419

06 MAY 2024

VMware Cloud Foundation 5.1.1

What's New

  • The versions of the NVIDIA Container Toolkit and Docker Community Engine are updated.

  • The description of the OVF properties shown when deploying a deep learning VM by using the OVF deployment wizard is improved.

  • The download URL format for vGPU guest drivers for disconnected environments now supports directory index listings, as generated by Web servers, such as NGINX or Apache HTTP Server.

  • A link to documentation of the VMware deep learning VM appears as a "message of the day" in the Ubuntu operating system.

Supported NVIDIA GPU Devices

VMware Deep Learning VM 1.0.1 supports the following GPUs on your ESXi hosts:

NVIDIA Component

Supported Option

NVIDIA GPUs

  • NVIDIA A100

  • NVIDIA L40S

  • NVIDIA H100

GPU sharing mode

  • Time slicing

  • Multi-Instance GPU

Components of VMware Deep Learning VM 1.0.1

This version of the deep learning virtual machine image contains the following software:

Software Component Category

Software Component

Version

Embedded

Canonical Ubuntu

22.04

NVIDIA Container Toolkit

1.15.0

Docker Community Engine

26.0.2

Can be pre-installed automatically

NVIDIA vGPU guest driver

According to the version of the NVIDIA vGPU host driver

Deep learning (DL) workload from NVIDIA NGC

CUDA Sample

-

PyTorch

-

TensorFlow

-

DCGM Exporter

-

Triton Inference Server

-

NVIDIA RAG

-

Resolved Issues

  • Unable to log in to a Docker private container registry if the registry password set in the OVF properties of the deep learning VM contains special characters, such as & < > " ' .

  • The OVF properties for a secondary container registry are not processed.

  • Running apt update fails because of errors and security warnings.

  • The execution status of the get-vgpu-driver.sh script, run at VM startup, is not reflected in the guestinfo.vmservice.bootstrap.condition setting of VM Tools.

VMware Deep Learning VM 1.0

Image Snapshot

VMware Deep Learning VM 1.0 is available for use with VMware Cloud Foundation 5.1.1.

Snapshot

Release Date

Compatible VMware Cloud Foundation Version

common-container-nv-vgpu-ubuntu-2204-v20240217

26 MAR 2024

VMware Cloud Foundation 5.1.1

Supported NVIDIA GPU Devices

VMware Deep Learning VM 1.0 supports the following GPUs on your ESXi hosts:

NVIDIA Component

Supported Option

NVIDIA GPUs

  • NVIDIA A100

  • NVIDIA L40S

  • NVIDIA H100

GPU sharing mode

  • Time slicing

  • Multi-Instance GPU

Components of VMware Deep Learning VM 1.0

The initial version of the deep learning virtual machine image contains the following software:

Software Component Category

Software Component

Version

Embedded

Canonical Ubuntu

22.04

NVIDIA Container Toolkit

1.13.5

Docker Community Engine

25.03

Can be pre-installed automatically

NVIDIA vGPU guest driver

According to the version of the NVIDIA vGPU host driver

Deep learning (DL) workload from NVIDIA NGC

CUDA Sample

-

PyTorch

-

TensorFlow

-

DCGM Exporter

-

Triton Inference Server

-

NVIDIA RAG

-

License Information

VMware Deep Learning VM releases are available under a VMware Private AI Foundation with NVIDIA license. See VMware Private AI Foundation with NVIDIA Guide.

Documentation

Examine the VMware Private AI Foundation with NVIDIA Guide for an overview and how-to instructions for running deep learning VMs in a VMware Cloud Foundation environment.

check-circle-line exclamation-circle-line close-line
Scroll to top icon