You can do continuous integration (CI) testing on your service tile.

There are two ways to do CI testing on your tile:

New partners can work on only one tile at a time.

Use Tile Dashboard CI to test your tile

With your tile in the Tile Dashboard CI testing system, you can monitor changes to Tanzu Operations Manager that might require changes in your tile. You can gain an understanding of your tile’s compatibility across Tanzu Operations Manager versions, underlying IaaS, and different flavors of environments. This means that you don’t have to maintain your own CI system and keep up with the latest Tanzu Operations Manager versions.

The Tile Dashboard CI is part of the VMware Enterprise Readiness criteria, which monitors of the quality and capabilities of your tile. For an introduction to our readiness criteria, see Enterprise Readiness criteria.

The Tile Dashboard CI test process

The Tile Dashboard CI runs your tile through a series of steps:

  1. Downloading your tile from the Broadcom Support portal and checking hash integrity.

  2. Scanning your tile for known or potential problems, such as:

    • Use of deprecated properties
    • Use of properties whose values/meanings have changed
    • Use of features that are no longer supported
  3. Configuring, installing, testing, and uninstalling your tile in several Tanzu Operations Manager environments:

    • A patch release of every supported VMware Tanzu Application Service for VMs minor version
    • Every supported IaaS
    • Environments with extra configuration, such as multiple availability zones and IPsec

The Tile Dashboard reports the results of each step. The results that are reported for each step include a pass/fail status, the run log, and the output. If a step fails for a reason unrelated to a tile; for example, a network glitch, you can retry that step from the Tile Dashboard CI.

Prerequisites

Before you use the Tile Dashboard to configure and test your tile, verify the following:

  • You must have a Slack account on the PivotalPartners.slack.com organization. If you don’t have an account, contact the technical program management through the Broadcom Partner Portal.

  • You belong to your company’s Slack channel in the PivotalPartners.slack.com organization.

  • Your tile is uploaded to the Broadcom Support portal.

    If you are uploading a… Then…
    First release Contact the technical program management through the Broadcom Partner Portal.
    Subsequent release You can upload pre-releases to the Broadcom Support portal.

Configuring a tile on the Tile Dashboard

After your tile is uploaded to the Broadcom Support portal, the Tile Dashboard starts to stage and scan it. For new tiles, this can take up to an hour.

After the stage and scan tasks, you must configure your tile on the Tile Dashboard. The configuration specifies how the tile is installed on the test environment.

Configuring your tile through the Tile Dashboard is equivalent to configuring the tile on Tanzu Operations Manager after you download it from the Broadcom Support portal.

There are two ways to configure the tile on the Tile Dashboard:

Method Notes and Restrictions For more information, see…
Through the Properties tab This is a form view of the installation properties. Configure your Tile using the Properties tab.
Through the Advanced - JSON Properties tab This is the list of properties displayed in JSON. Configure your Tile using the Advanced - JSON Properties tab.

Log on to the Tile Dashboard and locate the Configuration page

To log in to the Tile Dashboard and go to the Configuration page:

  1. Log on to your PivotalPartners.slack.com account.

  2. Go to the Tile Dashboard URL.

  3. Click Tiles in the menu bar.

  4. Click the row where your tile is listed.

  5. If your tile has more than one version, click the version you want to configure.

  6. Click Configure.

Configure your tile using the Properties tab

The Properties tab view allows you to configure installation properties through a form. The form pulls properties from your tile.yml file parsing the properties_blueprints. For general information about properties_blueprints, see Configuration properties.

In the form, you can configure:

  • strings
  • integers
  • boolean values
  • drop-down menus
  • network addresses, ports, secrets, and credentials

To configure other types, for example, nested collections, use the Advanced - JSON Properties tab, see Configure your tile using the Advanced - JSON Properties Tab.

For more information about property types, see Property and template references.

To configure install properties for your tile using the Properties tab:

  1. Complete the steps in Log in to the Tile Dashboard and locate the Configuration page.

  2. Click the Properties tab.

  3. Review or specify the value for each property. If a property is required and is missing valid values, the text box is shown in red.

  4. When the Properties* form is complete and there are no text boxes displayed in red, click Save or Save and Run.

Configure your tile using the advanced - JSON properties tab

In the Advanced - JSON Properties tab, you configure install properties, specifying them in JSON, in the format used by the om tool.

For more information about the format used by the om tool, see:

To configure install properties for your tile using the Advanced - JSON Properties tab:

  1. Complete the steps in Log in to the Tile Dashboard and locate the Configuration page.

  2. Click the Advanced - JSON Properties tab.

  3. Enter values for all required properties. If a property is required, you will see the required attribute: "required": true.

    For example:

    ".properties.syslog_selector.enabled.address": {
    "value": "",
    "type": "network_address",
    "required": true
    ...
    
  4. After entering values for properties, delete the required attribute. This tells Tile Dashboard that this field is now provided.

    For example:

    ".properties.syslog_selector.enabled.address": {
        "value": "192.0.2.1",
        "type": "network_address",
    
  5. Click Save.

Environment-sensitive values

Some property values, such as availability zone names, can vary between test environments. When the test is run for these environment-sensitive properties, VMware provides placeholder values that are replaced with appropriate values for each test environment. Descriptions of these placeholder values appear on the Tile Configuration tabs for reference.

Specify UAA users

To specify the UAA users:

  1. Complete the steps in Log on to the Tile Dashboard and locate the Configuration page.

  2. At the bottom of the configuration page, click + to expand and view the text box.

    The bottom of the page shows the plus button used to expand the UAA properties form.

  3. Enter the user name, password, and groups for the UAA user.

Save and run

When your configuration is complete, the config icon shows green. At this point, you can test the tile on all the environments. Follow these steps:

  1. Complete the steps in Log in to the Tile Dashboard and locate the Configuration page.

  2. Click Save and Run.

    This action tests the tile on all the environments.

    This message appears when the run starts: Success Config save succeeded. Tile CI has begun.

  3. Click Tiles in the toolbar to return to the Tiles view.

  4. Follow the progress of the tests in the Tiles view.

    The staged, scan, and config notations are the prerequisite jobs and they run in a series. The rest of the jobs are the environment jobs and they run in parallel. The environment jobs do not run until the config job has finished successfully.

    Stage, scan, and config test jobs are shown, followed by environment tests.

About test configuration

After your tile is installed, the Tile Dashboard runs any post-deploy errands your tile has defined, including tests. Ideally, your tile includes tests that use all of the capabilities of your tile.

About backing services

Your tile might require a backing service outside of the existing Tanzu Operations Manager environment; for example, your tile might be a service broker to a SaaS offering.

You are responsible for maintaining the backing service in an environment that the Tile Dashboard can reach; that is, it must be internet-facing.

Set up a Concourse pipeline and test your tile

The Tile Dashboard CI that VMware runs for its technical partnership program members uses the CI tool Concourse to verify that partner products continue to work with every new release of the platform.

You can also set up your own Concourse CI pipeline that integrates and tests your tile on your own deployment of the latest Tanzu Operations Manager using the instructions in the Concourse documentation.

While you are free to use any CI system, VMware’s tools and documentation were built to use Concourse CI.

Set up a Concourse server

You need a Concourse server to host your pipeline.

If you partner with VMware, the Tile Dashboard CI servers can host your pipeline and provide S3 storage to exchange artifacts with your own servers.

If you set up your own Concourse server, use the instructions in the Concourse documentation.

Create a Concourse pipeline for your tile

A typical CI pipeline for a tile consists of the following jobs:

  • Build the tile.
  • Deploy it to Tanzu Operations Manager.
  • Run a set of deployment tests to verify that it deployed without errors and works correctly.
  • Remove it from Tanzu Operations Manager.

You define this pipeline in the pipeline.yml file that is uploaded to the Concourse server. Tile Generator contains a sample pipeline that you can clone for your own tile.

Set up Tanzu Operations Manager for your CI pipeline

VMware partners who have VMware host their pipeline have access to a pool of Tanzu Operations Manager instances that are managed and regularly updated with the latest (pre-)release versions of Tanzu Operations Manager. If you set up your own Concourse server, you must target your pipeline to a Tanzu Operations Manager instance you have set up.

Concourse has a resource type to manage a pool of resources that are shared among pipelines, which is what we use to serialize Tanzu Operations Manager access between the partner pipelines that run on the Concourse server.

check-circle-line exclamation-circle-line close-line
Scroll to top icon