You can run an application in the entire GPU memory or only in a dedicated partition of the memory.
vSphere Bitfusion can allocate a GPU, run an application, and deallocate the GPU with a single CLI command or you can use individual commands to perform the same tasks.
Starting Applications with the Run Command The vSphere Bitfusion client can run machine learning applications on remote shared GPUs. By using the run command, you can start a single application in vSphere Bitfusion.
Allocating GPUs with the RUN Command You can run the run command to allocate GPUs for a single application. The application runs in the entire memory resource of the GPUs.
Partitioning GPU Memory You can run your application in a dedicated partition of a GPU's memory, and other applications can use the remaining GPU's memory.
GPU Partitioning Examples Multiple concurrent applications might use a GPU's computational capacity more efficiently than a single application. There are several ways you can partition the memory of your GPUs.
Starting Applications with Reserved GPUs You can allocate a number of GPUs and run multiple applications on the same GPUs.