Deploying a VI workload domain with a compute cluster that spans multiple racks requires Layer 3 networking and vSAN storage. To deploy such a workload domain, you use the VMware Cloud Foundation API and continue the setup after the deployment is complete.
A VI workload domain with a multi-rack compute cluster provides scalability, resilience, and optimal resource usage for customer workloads. The compute clusters in such workload domains have the following configuration:
- Layer 3 network fabric between the racks.
- A static IP pool with host overlay TEPs with a dedicated NSX host sub-transport node profile for each rack.
- Each rack is a fault domain in the vSAN cluster.
For more information on the a multi-rack compute cluster design, see vSphere Cluster Design Pattern One: Multi-Rack Compute Cluster with Layer 3 Network in the VMware Cloud Foundation Design Guide.
Procedure
What to do next
Consider deploying two additional vSphere clusters to host the NSX Edge nodes. See NSX Edge Cluster Design Pattern Two: Multi-Rack Edge Availability in the VMware Cloud Foundation Design Guide.
Deactivate Auto Policy Management for vSAN ESA
You cannot use auto policy management in a multi-rack VI workload domain with Layer 3 network because it is not supported with vSAN ESA and fault domains.
Procedure
- In a Web browser, log in to the workload domain vCenter Server at https://<vcenter_server_fqdn>/ui as [email protected].
- In the Hosts and clusters inventory, navigate to the multi-rack vSAN cluster.
- On the Configure tab for the cluster, select .
- In the vSAN ESA pane, click Edit.
- Toggle Auto-policy Management off and click Apply.
Create and Assign a New Default Storage Policy for vSAN ESA
By default, the vSAN ESA default storage policy is based on the number of hosts in the cluster during creation. To provide for fault domains that allow rack resiliency in a multi-rack cluster, you must create a default storage policy that is compatible with the number of racks.
Procedure
Create vSAN Fault Domains
Create a fault domain for each rack in the multi-rack cluster for rack resilience.
Procedure
- In the vSphere Client for the workload domain vCenter Server, in the Hosts and clusters inventory, navigate to the multi-rack cluster.
- On the Configure tab, select .
- Click the plus icon.
- In the New Fault Domain dialog box, enter the fault domain name, and select the hosts for the fault domain.
- Click Create.
- Repeat Step 3 to Step 5 for the other racks.
What to do next
During a future cluster expansion, add hosts manually to their respective fault domains.