Publish Remote XR Apps with NVIDIA CloudXR

You can access AR and VR applications running on a physical PC or a Windows virtual machine wirelessly with VMware Workspace ONE® XR Hub™. XR Hub provides easy access to Windows based AR/VR applications on devices running XR Hub using the NVIDIA CloudXR protocol.

Prerequisites

  1. A Workspace ONE Access environment. For more information, see Installing and Configuring VMware Workspace ONE Access.
  2. (Optional) If using a virtual machine to host AR/VR applications…

    1. A server that is certified to run VMware vSphere and NVIDIA vGPU, is NVIDIA certified, and capable of hosting NVIDIA GPU cards. For more information, see Server Installation and Setup and Configuring Virtual Graphics (vSphere).
    2. A VMware vSphere environment with NVIDIA License Service up and running. For more information, see NVIDIA vGPU™ Deployment Guide for VMware Horizon 7.5 on VMware vSphere 6.7.
    3. (Optional) A functioning VMware Horizon environment that is connected to your Workspace ONE Access environment. For more information, see Components and Architecture (VMware TechZone) and Set up Your Workspace ONE Access Environment for Horizon Integration.
    4. Windows 10/11 virtual machine with 4 vCPUs, 16GB vRAM, and 16GB vGPU profile.
  3. (Optional) If using a physical PC to host AR/VR applications…

    1. Install a physical NVIDIA GPU, RTX4000 or higher.
    2. Ensure the PC has enough CPU and RAM to run the AR/VR apps.
  4. NVIDIA CloudXR Server executable (available with the XR Hub download).

  5. Optionally, download the CloudXR SDK from NVIDIA. You must register with NVIDIA to access the CloudXR SDK. For more information, see NVIDIA CloudXR.
  6. SteamVR Runtime - https://partner.steamgames.com/doc/features/steamvr/enterprise

Standalone AR/VR Device Setup

In order to securely access remote hosted AR/VR applications on a standalone VR device, you will need to deploy the Workspace ONE XR Hub and CloudXR Client to the device.

  1. Ensure that Workspace ONE XR Hub is installed on the device. For more information, see Configure Workspace ONE XR Hub.
  2. Configure XR Hub application configuration with the bundle ID of CloudXR Client. For more information, see Configure Workspace ONE XR Hub.
  3. Install CloudXR Client for headset.

    Currently, the CloudXR client is available for VIVE Focus and Oculus Quest devices.

    1. Download the CloudXR Client (available from the XR Hub download portal).
    2. Optionally, you can downloaded the latest CloudXR SDK from NVIDIA https://www.nvidia.com/en-gb/design-visualization/solutions/cloud-xr/ Follow the instructions in the CloudXR SDK documentation to extract/create the sample client needed for your headset.
    3. Deploy the CloudXR Sample Client to your XR devices using Workspace ONE UEM. For more information, see Deploying Internal Application on Android Devices.

Windows Machine Preparation

  1. Log in to Windows desktop.
  2. Install the latest Windows updates.
  3. Install DirectX Runtime.
  4. Install Steam VR (this does not require Steam) https://partner.steamgames.com/doc/features/steamvr/enterprise.
  5. Follow the CloudXR documentation to install CloudXR WIndows executable on your Windows host.
  6. (Tech Preview) If using VMware Horizon, unzip the XRHubCloudLink.zip file to C:\Program Files\VMware\VMware XR Hub\
  7. Launch SteamVR.
  8. Ensure CloudXR Addon is enabled in SteamVR.
  9. Try launching your AR/VR application from SteamVR.
  10. Configure the desktop to auto launch SteamVR at startup.

Configure XR Hub with CloudXR Apps

In order for remote hosted AR/VR applications to appear in the Workspace ONE XR Hub, the applications must be published using one of three methods.

Once a remote hosted AR/VR application is published correctly, the application icon appears in the Workspace ONE XR Hub application catalog for users to access.

We support publishing remote hosted AR/VR applications using SteamVR and NVIDIA CloudXR.

You can publish remote hosted AR/VR applications to Workspace ONE XR Hub in three different ways.

  • (Recommended) Workspace ONE Access publishes applications running on physical PCs or applications running on virtual machines hosted on VMware vSphere or another cloud service.
  • (Optional) The manual method publishes applications to XR Hub using the Workspace ONE XR Hub application configuration.
  • (Tech Preview) VMware Horizon manages and secures virtual desktops running AR/VR applications in a scalable way.

Publish Remote Hosted AR/VR Applications Using Workspace ONE Access

Publishing remote AR/VR applications using Workspace ONE Access is done by setting up a web link application in Workspace ONE Access and configuring the URL to point to the IP of the machine hosting the AR/VR application(s).

This approach requires that the hosting desktop is logged in and SteamVR is running. Workspace ONE XR Hub does not log the user into the desktop automatically.

Once a remote AR/VR application is correctly published using Workspace ONE Access, the application appears in the Immersive Apps category in the XR Hub.

Follow these steps to publish a remote AR/VR application to XR Hub using Workspace ONE Access.

  1. Login to the Workspace One Access Admin Console as your tenant admin.
  2. Navigate to Resources > Web Apps.
  3. Select New and it will display the New SaaS Application window.
  4. Add the CloudXR App Settings

    a. Add a Name for your application.

    b. Upload an Icon for your application.

    c. Add the application to a category called CloudXR.

    d. Select Next

  5. Add the CloudXR Configuration Settings

    a. Select Authentication Type and select Web Application Link.

    b. For Target URL use the CloudXR VM/PC IP Address.

    d. Select Next

  6. Assign Users/Groups to the CloudXR Application

    a. Select Save and Assign.

    b. Type the users / groups you want to assign the WebXR application to.

    c. For Deployment Type Select Automatic.

    d. For Entitlement Type Select Include.

    e. Select Save.

Once the CloudXR category is set for an application, the application/desktop appears in ONE XR Hub under the Immersive Apps category.

  • Login to Workspace ONE Access as the user entitled to the CloudXR app and check that the entitlement appears in the App Portal.
  • When a user clicks on the application icon in XR Hub, XR Hub launches the CloudXR client and connects to the desktop using CloudXR.
  • If successfully connected, the user is presented with the SteamVR menu in VR.

Publish Remote Hosted PC VR Applications Using VMware Horizon (Tech Preview)

Using VMware Horizon to host remote PC VR applications delivers the benefit of “single click” access to remote PC VR applications from XR Hub on standalone VR devices.

VMware Horizon can automatically provision virtual desktops to host PC VR applications, provides single sign-on into those virtual desktops and automatically launches the chosen PC VR application to be streamed to XR Hub.

Publish Applications using VMware Horizon

To publish applications using VMware Horizon, you must ensure that VMware Horizon is connected to Workspace ONE Access. For more information about integrating the two products, see Horizon Components and Architecture Diagram and Set up Your Workspace ONE Access Environment for Horizon Integration.

Once Workspace ONE Access is integrated with VMware Horizon, by default, VMware Horizon applications and desktops appear under the Horizon Apps category in Workspace ONE XR Hub.

In order to have PC VR applications appear in the Immersive Apps category in XR Hub, PC VR applications are published as VM Hosted Applications and marked with the RemoteXR category in Workspace ONE Access.

Publishing PC VR applications using Horizon’s VM Hosted Application feature will ensure that the application is automatically launched once a user is connected to the Horizon desktop from XR Hub.

XR Hub Cloud Link

A component called XR Hub Cloud Link is used to orchestrate launching PC VR applications once a user is connected from XR Hub to a Horizon VM Hosted Application. XR Hub Cloud Link needs to be copied to the virtual desktop and set as the application to be launched in the application pool settings. The PC VR executable path is configured as a parameter to XR Hub Cloud Link so that the application can be launched once a VR device is connected to the Horizon desktop via XR Hub.

Requirements:

  • Horizon 21.11+
  • HTML Access is installed and configured for Horizon Connection Server.
  • Workspace ONE Access Connector latest version.
  • XR Hub 23.04+ for your VR device.
  • XR Hub Cloud Link for your VMware Horizon desktop.

To publish a remote hosted PC VR application to XR Hub, take the following steps.

VMware Horizon Console

  1. Log in to VMware Horizon Administration console.
  2. Create or edit the desktop pool to host PC VR applications.

    Create a desktop pool using the Windows 10 desktop image you have prepared in the previous section.

    a. Set the Session Types to Application.

    b. Set Automatically Logoff After Disconnect to Never.

    c. Set HTML Access to Enabled.

  3. Create an application pool with the following parameters:

    a. Application Pool Type: Desktop Pool.

    b. Path: C:\Program Files\VMware\VMware XR Hub\XRHubCloudLink.exe

    c. Parameter: -link -runApp --app-name "PATH TO YOUR VR APP EXE"

    d. Pre-Launch: Disabled.

    e. For more information, see VMware Horizon 7.9 Desktop Application Publishing - Feature Walk-Through.

    f. Ensure users is entitled to the application pool and desktop pool.

  4. Save the changes.

Workspace ONE Access Console

  1. Log in to Workspace ONE Access Console as an administrator.
  2. Sync Virtual Apps Collection - Resources > Virtual Apps Collection > Select the instance of Horizon > Sync
  3. Go to Virtual Apps
  4. Add the Horizon application(s) to the RemoteXR category (you might need to add this category).
  5. Log in to Workspace ONE Access as the user entitled to the application and confirm that the entitlement appears in the App Portal.

Once the category RemoteXR is added to the application, the application/desktop appears in the Workspace ONE XR Hub app under the Immersive App category.

When a user clicks on the application icon, the virtual desktop or application is provisioned/powered on by VMware Horizon. The user is logged into the desktop automatically. SteamVR then starts. At that point, Workspace ONE XR Hub launches the CloudXR client and connects to the desktop using CloudXR.

If successfully connected, the user is presented with the SteamVR menu in VR.

Publish Remote Hosted AR/VR Applications Manually

Publishing applications manually via the XR Hub configuration is not recommended. This hardcoding of applications makes application management difficult and time intensive. Manual publishing means users must restart their device or Workspace ONE XR Hub application in order to load the new configuration.

You cannot publish VMware Horizon hosted CloudXR applications using this method. The manual publishing approach requires that the hosting desktop is logged in and SteamVR is running. Workspace ONE XR Hub does not log the user into the desktop automatically.

Once a remote AR/VR application is correctly added and the configuration pushed to the headset, the application appears in the Immersive Apps category in the XR Hub.

If not using Workspace ONE Access, CloudXR Applications can be configured in Workspace ONE UEM using the XR Hub application configuration.

  1. In the Workspace ONE UEM console, navigate to Resources > Apps > Native and select the Internal tab.
  2. Select the current version number of XR Hub (for example “23.4.0.0”) in the UEM Version column. The App Details View displays.
  3. Select the Assign button at the top right of the Details View to launch the assignment window.
  4. Select the Assignment Name to edit the XR Hub configuration for that assignment.
  5. Select the Application Configuration tab. Enable the Send Configuration slider to edit the XR Environment settings.
  6. Click on CONFIGURE next to the Applications settings item.
  7. Edit the CloudXR Browser Configuration settings.

    Setting Description
    Application Type Remote XR
    Name Enter a name for the application, such as “Remote VR App01”
    URL Enter the URL for the application, for example https://immersive-web.github.io/webxr-samples/immersive-vr-session.html

When a user clicks on the application icon, Workspace ONE XR Hub launches the CloudXR client and connects to the desktop using CloudXR.

If successfully connected, the user is presented with the SteamVR menu in VR.

Connecting to a CloudXR app from Workspace ONE XR Hub

  1. Launch XR Hub.
  2. Enter your credentials.
  3. Find your application within the Immersive Apps category.
  4. Click on the application icon to connect to the CloudXR application.
check-circle-line exclamation-circle-line close-line
Scroll to top icon