After all ESXi hosts have been added to the cluster, create a vSphere Distributed Switch to handle the traffic of the management applications in the SDDC. You must also create port groups to prepare your environment to migrate the Platform Services Controller and vCenter Server instances to the distributed switch.

Procedure

  1. Log in to the Management vCenter Server by using the vSphere Web Client.
    1. Open a Web browser and go to https://sfo01m01vc01.sfo01.rainpole.local/vsphere-client.
    2. Log in using the following credentials.

      Setting

      Value

      User name

      administrator@vsphere.local

      Password

      vsphere_admin_password

  2. Create vSphere Distributed Virtual Switch.
    1. In the Navigator, click Networking and expand the sfo01m01vc01.sfo01.rainpole.local tree.
    2. Right-click the sfo01-m01dc datacenter, and select Distributed Switch > New Distributed Switch to start the New Distributed Switch wizard.
    3. On the Name and location page, enter sfo01-m01-vds01 as the name and click Next.
    4. On the Select version page, ensure the Distributed switch: 6.5.0 radio button is selected and click Next.
    5. On the Edit settings page, enter the following values and click Next.

      Setting

      Value

      Number of uplinks

      2

      Network I/O Control

      Enabled

      Create a default port group

      Deselected

    6. On the Ready to complete page, review your entries and click Finish.
  3. Edit the settings of the sfo01-m01-vds01 distributed switch.
    1. Right-click the sfo01-m01-vds01 distributed switch, and select Settings > Edit Settings.
    2. Click the Advanced tab.
    3. Enter 9000 as MTU (Bytes) value, and click OK.
  4. Create port groups in the sfo01-m01-vds01 distributed switch for the management traffic types.
    1. Right-click the sfo01-m01-vds01 distributed switch, and select Distributed Port Group > New Distributed Port Group
    2. Create port groups with the following settings and click Next.

      Port Group Name

      Port Binding

      VLAN Type

      VLAN ID

      sfo01-m01-vds01-management

      Ephemeral - no binding

      VLAN

      1611

      sfo01-m01-vds01-vmotion

      Static binding

      VLAN

      1612

      sfo01-m01-vds01-vsan

      Static binding

      VLAN

      1613

      sfo01-m01-vds01-nfs

      Static binding

      VLAN

      1615

      sfo01-m01-vds01-replication

      Static binding

      VLAN

      1616

      sfo01-m01-vds01-ext-management

      Static binding

      VLAN

      130

      sfo01-m01-vds01-uplink01

      Static binding

      VLAN

      2711

      sfo01-m01-vds01-uplink02

      Static binding

      VLAN

      2712

      Note:

      The port group for VXLAN traffic is automatically created later during the configuration of the NSX Manager for the management cluster.

    3. On the Ready to complete page, review your entries, and click Finish.
    4. Repeat this step for each port group.
  5. Change the port groups to use the Route Based on Physical NIC Load teaming algorithm.
    1. Right-click the sfo01-m01-vds01 distributed switch and select Distributed Port Group > Manage Distributed Port Groups.
    2. On the Select port group policies page, select Teaming and failover and click Next.
    3. Click the Select distributed port groups button, add all port groups except sfo01-m01-vds01-uplink01 and sfo01-m01-vds01-uplink02, click OK and click Next.
    4. On the Teaming and failover page, select Route based on physical NIC load from the Load balancing drop-down menu and click Next.
    5. Click Finish.
  6. Configure the uplinks for the sfo01-m01-vds01-uplink01 and sfo01-m01-vds01-uplink02 port groups.
    1. Right click the sfo01-m01-vds01-uplink01 port group, and click Edit Settings.
    2. Select Teaming and Failover.
    3. Move dvUplink2 to Unused uplinks and click OK.
    4. Right click the sfo01-m01-vds01-uplink02 port group, and click Edit Settings.
    5. Select Teaming and Failover.
    6. Move dvUplink1 to Unused uplinks and click OK.
  7. Connect the ESXi host, sfo01m01esx01.sfo01.rainpole.local, to the sfo01-m01-vds01 distributed switch by migrating their VMkernel and virtual machine network adapters.
    1. Right-click the sfo01-m01-vds01 distributed switch, and click Add and Manage Hosts.
    2. On the Select task page, select Add hosts and click Next
    3. On the Select hosts page, click New hosts.
    4. In the Select new hosts dialog box, select sfo01m01esx01.sfo01.rainpole.local and click OK.
    5. On the Select hosts page, click Next.
    6. On the Select network adapter tasks page, ensure that Manage physical adapters and Manage VMkernel adapters check boxes are selected, and click Next.
    7. On the Manage physical network adapters page, click vmnic1 and click Assign uplink.
    8. In the Select an Uplink for vmnic1 dialog, select Uplink 1 and click OK.
    9. On the Manage physical network adapters page, click Next.
  8. Configure the VMkernel network adapters, edit the existing, and add new adapters as needed.
    1. On the Manage VMkernel network adapters page, click vmk0 and click Assign port group.
    2. Select sfo01-m01-vds01-management and click OK.
    3. On the Manage VMkernel network adapters page, click On this switch and click New adapter
    4. On the Add Networking page, select Select an existing network, browse to select the sfo01-m01-vds01-vsan port group, click OK, and click Next.
    5. On the Port properties page, select the vSAN check box and click Next.
    6. On the IPv4 settings page, select Use static IPv4 settings, enter IP address 172.16.13.101, enter subnet 255.255.255.0, and click Next.
    7. Click Finish.
    8. Repeat steps 8c. - 8f. to create the remaining VMkernel network adapters and then click Next.

      Port Group

      Port Properties

      IPv4 Address

      Netmask

      sfo01-m01-vds01-replication

      • vSphere Replication

      • vSphere Replication NFC

      172.16.16.101

      255.255.255.0

      sfo01-m01-vds01-nfs

      N/A

      172.16.15.101

      255.255.255.0

    9. On the Analyze impact page, click Next.
    10. On the Ready to complete page, review your entries and click Finish.
  9. Create the vMotion VMkernel adapter.
    1. In the Navigator, click Host and Clusters and expand the sfo01m01vc01.sfo01.rainpole.local tree.
    2. Click on sfo01m01esx01.sfo01.rainpole.local.
    3. Click the Configure tab then select VMkernel adapters.
    4. Click the Add host networking icon and select VMkernel Network Adapter and click Next.
    5. On the Add Networking page, click Select an existing network, browse to select the sfo01-m01-vds01-vmotion port group, click OK, and click Next.
    6. On the Port properties page, select vMotion from the TCP/IP Stack drop-down and click Next.
    7. On the IPv4 settings select Use static IPv4 settings enter IP address 172.16.12.101, enter subnet 255.255.255.0, and click Next.
    8. On the Ready to complete page, review the configuration and click Finish.
  10. Configure the MTU on the vMotion VMkernel adapter.
    1. Select the vMotion VMkernel adapter created in the previous step, and click Edit Settings.
    2. Click the NIC Settings page.
    3. Enter 9000 for the MTU value and click OK.
  11. Configure the vMotion TCP/IP stack.
    1. Click TCP/IP configuration.
    2. Select vMotion and click the Edit TCP/IP stack configuration icon.
    3. Click on Routing and enter 172.16.12.253 for the VMkernel gateway and click OK.
  12. Migrate the Platform Services Controllers and vCenter Server instances from the standard switch to the distributed switch.
    1. In the Navigator, click Networking and expand the sfo01m01vc01.sfo01.rainpole.local tree.
    2. Right-click the sfo01-m01-vds01 distributed switch and click Migrate VM to Another Network.
    3. On the Select source and destination networks page, browse the following networks and click Next.

      Setting

      Value

      Source network

      VM Network

      Destination network

      sfo01-m01-vds01-management

    4. On the Select VMs to migrate page, select sfo01m01psc01.sfo01.rainpole.local, sfo01w01psc01.sfo01.rainpole.local and sfo01m01vc01.sfo01.rainpole.local, and click Next.
    5. On the Ready to complete page, review your entries and click Finish.
  13. Define Network I/O Control shares for the different traffic types on the sfo01-m01-vds01 distributed switch.
    1. Click the sfo01-m01-vds01 distributed switch, click the Configure tab, and click Resource Allocation > System traffic.
    2. Under System Traffic, configure each of the following traffic types with the following values.

      Traffic Type

      Physical adapter Shares

      Virtual SAN Traffic

      High

      NFS Traffic

      Low

      vMotion Traffic

      Low

      vSphere Replication (VR) Traffic

      Low

      Management Traffic

      Normal

      vSphere Data Protection Backup Traffic

      Low

      Virtual Machine Traffic

      High

      Fault Tolerance Traffic

      Low

      iSCSI Traffic

      Low

  14. Migrate the last physical adapter from the standard switch to the sfo01-m01-vds01 distributed switch.
    1. In the Navigator, click Networking and expand the sfo01m01vc01.sfo01.rainpole.local tree.
    2. Right-click the sfo01-m01-vds01 distributed switch and select Add and Manage Hosts.
    3. On the Select task page, select Manage host networking, and click Next.
    4. On the Select hosts page, click Attached hosts.
    5. In the Select member hosts dialog, select sfo01m01esx01.sfo01.rainpole.local, click OK and click Next.
    6. On the Select network adapter tasks page, select Manage physical adapters only, and click Next.
    7. On the Manage physical network adapters page, select vmnic0, and click Assign uplink.
    8. In the Select an Uplink for vmnic1 dialog box, select Uplink 2, and click OK, and click Next.
    9. On the Analyze Impact page, click Next.
    10. On the Ready to complete page, click Finish.
  15. Enable vSphere Distributed Switch Health Check.
    1. In the Navigator, click Networking and expand the sfo01m01vc01.sfo01.rainpole.local tree.
    2. Select the sfo01-m01-vds01 distributed switch and click the Configure tab.
    3. In the Navigator select Health check and click the Edit button.
    4. Select Enabled for VLAN and MTU and Teaming and failover and click OK.
  16. Delete the vSphere Standard Switch.
    1. In the Navigator, click on Hosts and Clusters and expand the sfo01m01vc01.sfo01.rainpole.local tree.
    2. Click on sfo01m01esx01.sfo01.rainpole.local and then click the Configure tab.
    3. On the Configure page, select Virtual switches, choose vSwitch0, and then click on the Remove selected standard switch icon.
    4. In the Remove Standard Switch dialog, click Yes to confirm the removal.