After upgrading all NSX Manager appliances and the NSX Controller cluster, you should update all host clusters in the cross-vCenter NSX environment.

Upgrading the host clusters upgrades the NSX VIBs.

If you are upgrading from NSX 6.2.x, hosts must be rebooted to finish the upgrade.
  • If the cluster has DRS enabled, when you click Resolve all, DRS attempts to reboot the hosts in a controlled fashion that keeps the VMs running. VMs are moved to other hosts in the cluster and the hosts enter maintenance mode and are rebooted.
  • If the cluster does not have DRS enabled, you must power off or vMotion the VMs manually before beginning the upgrade. When you click Resolve all, the hosts enter maintenance mode and are rebooted.
If you are upgrading from NSX 6.3.0 or later, the hosts must enter maintenance mode to finish the upgrade. Rebooting is not required.
  • If the cluster has DRS enabled, when you click Resolve all, DRS attempts to put the hosts into maintenance mode in a controlled fashion that allows the VMs to continue running. VMs are moved to other hosts in the cluster and the hosts enter maintenance mode.
  • If the cluster does not have DRS enabled, you must power off or vMotion the VMs manually before beginning the upgrade. You must manually put the hosts into maintenance mode to complete the upgrade.

In NSX 6.3.5 and later you can view the EAM status on the Host Preparation tab.

Prerequisites

  • Upgrade NSX Manager and the NSX Controller cluster.
  • Log out of and log back in to the vSphere Web Client after upgrading NSX Manager and before upgrading the host clusters.
  • Verify that the current vSphere and ESXi versions are compatible with the NSX Data Center for vSphere version you are upgrading to. See the VMware Interoperability Matrix at https://partnerweb.vmware.com/comp_guide2/sim/interop_matrix.php#interop&93=&2=&1=.
  • Make sure that you understand the operational impact of a host cluster upgrade while the upgrade is in progress. See Operational Impacts of NSX Upgrades.
  • Make sure the fully qualified domain names (FQDNs) of all hosts can be resolved.
  • If DRS is disabled, power off or vMotion the VMs manually before beginning the upgrade.
  • If DRS is enabled, the running VMs are moved automatically during the host cluster upgrade. Before beginning the upgrade, make sure that DRS can work in your environment.
    • Make sure that DRS is enabled on the host clusters.
    • Make sure that vMotion functions correctly.
    • Check the host connection state with vCenter.
    • Check that you have a minimum three ESXi hosts in each host cluster. During an NSX upgrade, a host cluster with only one or two hosts is more likely to have problems with DRS admission control. For a successful NSX upgrade, ensure that each host cluster has at least three hosts. If a cluster contains fewer than three hosts, manually evacuate the hosts.
    • In a small cluster with only two or three hosts, if you have created anti-affinity rules stating that certain VMs must reside on separate hosts, DRS might fail to move the VMs during the upgrade. Either add additional hosts to the cluster or disable the anti-affinity rules during the upgrade and reenable them after the upgrade is finished. To disable an anti-affinity rule, go to Hosts and Clusters. In the Navigator, right-click the cluster, and click Settings. Navigate to Configure > Configuration > VM/Host Rules. Edit the rule and deselect Enable rule.
  • Log into one of the hosts in the cluster and run the esxcli software vib list command.

    The VIBs present will depend on the ESXi and NSX versions, and therefore might change as part of the upgrade. Note the current version of the installed VIBs:

    ESXi version NSX version VIBs installed
    6.0 or later 6.3.2 or earlier
    • esx-vsip
    • esx-vxlan
    6.0 or later 6.3.3 or later
    • esx-nsxv
    Note: Some versions of NSX Data Center for vSphere have additional VIBs which are removed during the upgrade.
    • If you are upgrading from NSX 6.2.x where the version is NSX 6.2.4 or later, prepared hosts have an extra VIB, esx-vdpi.

Procedure

  1. In the vSphere Web Client, navigate to Home > Networking & Security > Installation and Upgrade, select the Host Preparation tab.
  2. For each cluster that you want to upgrade, click Upgrade or Upgrade available.
    If you are upgrading to NSX 6.4.1, click Upgrade for the cluster.
    When you upgrade to 6.4.1 or later, click the upgrade link to upgrade the NSX components installed on a host cluster.
    If you are upgrading to NSX 6.4.0, click Upgrade Available for the cluster.
    The cluster displays Installing NSX or Installing, and the hosts display In Progress.
  3. The cluster and host status displays Not Ready. Click Not Ready to display more information. Click Resolve all to attempt to finish the VIB installation.
    The hosts are put in maintenance mode, and rebooted if necessary, to finish the upgrade.
    The cluster displays Installing NSX or Installing.

    When the upgrade is finished, each host displays a green check mark and the upgraded NSX version.

  4. If the Resolve action fails when DRS is enabled, the hosts might require manual intervention to enter maintenance mode (for example, due to HA requirements or DRS rules). In this case, the upgrade process stops and the cluster displays Not Ready again. Click Not Ready to display more information. Check the hosts in the Hosts and Clusters view, make sure that the hosts are powered on, connected, and contain no running VMs. Then retry the Resolve action.
    The cluster displays Installing NSX or Installing.

    When the upgrade is finished, each host displays a green check mark and the upgraded NSX version.

  5. If the Resolve action fails when DRS is disabled and you are upgrading from NSX 6.3.0 or later with ESXi 6.0 or later, you must manually put the hosts into maintenance mode to finish the upgrade.
    1. Put the evacuated hosts in maintenance mode.

      In Hosts and Clusters, right-click each host and select Maintenance Mode > Enter Maintenance Mode.

    2. Navigate to Networking & Security > Installation and Upgrade > Host Preparation to monitor the upgrade.
      The upgrade automatically starts when the hosts enter maintenance mode. The cluster displays Installing NSX or Installing. If you do not see the status, refresh the page.
      When the upgrade is finished, each host displays a green check mark and the upgraded NSX version.
    3. Take the hosts out of maintenance mode.

      In Hosts and Clusters, right-click each host and select Maintenance Mode > Exit Maintenance Mode.

Results

To confirm the host update, log into one of the hosts in the cluster and run the esxcli software vib list command. Make sure that the appropriate VIBs have been updated to the expected version.

If a host fails to upgrade, perform the following troubleshooting steps:
  • Check the ESX Agent Manager on vCenter, and look for alerts and errors.
  • Log in to the host, check the /var/log/esxupdate.log log file, and look for recent alerts and errors.
  • Ensure that DNS and NTP are configured on the host.

See "Host Preparation" in the NSX Troubleshooting Guide for more troubleshooting steps.