This topic explains how to upgrade VMware Tanzu Kubernetes Grid Integrated Edition (TKGI) in Antrea and Flannel Networking environments from v1.15 to v1.16 on vSphere, Google Cloud Platform (GCP), Amazon Web Services (AWS), and Azure.
For instructions on upgrading Tanzu Kubernetes Grid Integrated Edition on vSphere with NSX-T networking, see Upgrading Tanzu Kubernetes Grid Integrated Edition (NSX-T Networking).
Warning: Do not manually upgrade your Kubernetes version. Tanzu Kubernetes Grid Integrated Edition includes the compatible Kubernetes version.
Before you upgrade, follow the procedures in Prepare to Upgrade below to plan and prepare your upgrade.
After you complete the preparation steps, continue to the procedures in Perform the Upgrade below. These steps guide you through the process of upgrading Ops Manager and the Tanzu Kubernetes Grid Integrated Edition tile, importing a new stemcell, and applying the changes to your deployment.
After you complete the upgrade, follow the procedures in After the Upgrade below to verify that your upgraded Tanzu Kubernetes Grid Integrated Edition deployment is running properly.
If you have not already, complete all of the steps in Upgrade Preparation Checklist for Tanzu Kubernetes Grid Integrated Edition.
Note: Kubernetes v1.25 does not serve the policy/v1beta1 PodSecurityPolicy
API. You must replace PodSecurityPolicy
configurations with PSA before upgrading to TKGI v1.16.
This section describes the steps required to upgrade to Tanzu Kubernetes Grid Integrated Edition v1.16:
Each version of Tanzu Kubernetes Grid Integrated Edition is compatible with multiple versions of Ops Manager.
Warning: If you use an automated pipeline to upgrade TKGI, see Configure Automated Ops Manager and Ubuntu Jammy Stemcell for VMware Tanzu Downloading in Configuring the Upgrade Pipeline.
To determine Ops Manager compatibility and, if necessary, upgrade Ops Manager:
When you upgrade Tanzu Kubernetes Grid Integrated Edition, your configuration settings typically migrate to the new version automatically. To download and import a Tanzu Kubernetes Grid Integrated Edition version:
Download the desired version of the product from Broadcom Support.
Navigate to the Ops Manager Installation Dashboard and click Import a Product to upload the product file.
Under the Import a Product button, click + next to Tanzu Kubernetes Grid Integrated Edition. This adds the tile to your staging area.
TKGI requires an Ubuntu Jammy Stemcell for VMware Tanzu. A Windows 2019 Windows Stemcell for VMware Tanzu is also required if you intend to create Windows worker-based clusters. For information about Windows stemcells, see Configuring Windows Worker-Based Clusters.
Warning: If you use an automated pipeline to upgrade TKGI, see Configure Automated Ops Manager and Ubuntu Jammy Stemcell Downloading in Configuring the Upgrade Pipeline.
If Ops Manager does not have the Ubuntu Jammy Stemcell for VMware Tanzu required for Tanzu Kubernetes Grid Integrated Edition v1.16, the Tanzu Kubernetes Grid Integrated Edition tile displays the message Missing stemcell. To download and import a new Ubuntu Jammy Stemcell for VMware Tanzu, follow the steps below:
On the Tanzu Kubernetes Grid Integrated Edition tile, click the Missing stemcell link.
In the Stemcell Library, locate the Tanzu Kubernetes Grid Integrated Edition tile and note the required stemcell version.
Navigate to the Stemcells (Ubuntu Jammy) page on Broadcom Support and download the required stemcell version for your IaaS.
Return to the Installation Dashboard in Ops Manager and click Stemcell Library.
On the Stemcell Library page, click Import Stemcell and select the stemcell file you downloaded from Broadcom Support.
Select the Tanzu Kubernetes Grid Integrated Edition tile and click Apply Stemcell to Products.
Verify that Ops Manager successfully applied the stemcell. The stemcell version you imported and applied appears in the Staged column for Tanzu Kubernetes Grid Integrated Edition.
Return to the Installation Dashboard.
Tanzu Kubernetes Grid Integrated Edition supports using the Antrea Container Network Interface (CNI) as the CNI for new TKGI-provisioned clusters.
To configure Tanzu Kubernetes Grid Integrated Edition to use Antrea as the CNI for new clusters:
For more information about Tanzu Kubernetes Grid Integrated Edition support for Antrea and Flannel CNIs, see About Switching from the Flannel CNI to the Antrea CNI in About Tanzu Kubernetes Grid Integrated Edition Upgrades.
To verify your Errands pane is correctly configured, do the following:
In the Tanzu Kubernetes Grid Integrated Edition tile, click Errands.
Under Post-Deploy Errands:
Warning: Deactivating the Upgrade all clusters errand causes the TKGI version tagged in your Kubernetes clusters to fall behind the Tanzu Kubernetes Grid Integrated Edition tile version. If you deactivate the Upgrade all clusters errand when upgrading the Tanzu Kubernetes Grid Integrated Edition tile, you must upgrade all your Kubernetes clusters before the next Tanzu Kubernetes Grid Integrated Edition upgrade.
Click Save.
To confirm your other Tanzu Kubernetes Grid Integrated Edition tile panes are correctly configured, do the following:
Note: When you upgrade Tanzu Kubernetes Grid Integrated Edition, you must place singleton jobs in the AZ you selected when you first installed the Tanzu Kubernetes Grid Integrated Edition tile. You cannot move singleton jobs to another AZ.
WARNING: Do not change the number of control plane/etcd nodes for any plan that was used to create currently-running clusters. Tanzu Kubernetes Grid Integrated Edition does not support changing the number of control plane/etcd nodes for plans with existing clusters.
To complete the upgrade of the Tanzu Kubernetes Grid Integrated Edition tile:
Return to the Installation Dashboard in Ops Manager.
Click Review Pending Changes. For more information about this Ops Manager page, see Reviewing Pending Product Changes.
Click Apply Changes.
(Optional) To monitor the progress of the Upgrade all clusters errand using the BOSH CLI, do the following:
bosh -e MY-ENVIRONMENT log-in
from a VM that can access your Tanzu Kubernetes Grid Integrated Edition deployment. For more information, see Using BOSH Diagnostic Commands in Tanzu Kubernetes Grid Integrated Edition.bosh -e MY-ENVIRONMENT tasks
.bosh task TASK-NUMBER
, replacing TASK-NUMBER
with the task number you located in the previous step.After you complete the upgrade to Tanzu Kubernetes Grid Integrated Edition v1.16, complete the following verifications and upgrades:
Upgrade the TKGI and Kubernetes CLIs on any local machine where you run commands that interact with your upgraded version of Tanzu Kubernetes Grid Integrated Edition.
To upgrade the CLIs, download and re-install the TKGI and Kubernetes CLI distributions that are provided with Tanzu Kubernetes Grid Integrated Edition on Broadcom Support.
For more information about installing the CLIs, see the following topics:
After you apply changes to the Tanzu Kubernetes Grid Integrated Edition tile and the upgrade is complete, do the following:
Verify that your Kubernetes environment is healthy. To verify the health of your Kubernetes environment, see Verifying Deployment Health.
For any cluster upgrade that fails, you can use the BOSH ID of the upgrade task for debugging. To retrieve the BOSH task ID, see Retrieve Cluster Upgrade Task ID in Verifying Deployment Health.