Installing the Streaming Server

The Greenplum Streaming Server (GPSS) components are included in the Greenplum Database 5 and 6 server distributions. If you want to install the newest version of these components, you may be required to download a package from the VMware Greenplum Streaming Server tile on VMware Tanzu Network.

GPSS packages available for download for Red Hat/CentOS 6 and 7, Red Hat 8, Photon 3, and Ubuntu 18.04 LTS systems include:

GPSS gppkg Installer - A .gppkg file that you install to upgrade GPSS on all hosts in your Greenplum Database cluster.
GPSS ETL Installer - An .rpm or .deb file that you use to install or upgrade GPSS on a dedicated ETL server host with no Greenplum Database bits installed.
GPSS tarball - A .tar.gz file that you install to upgrade GPSS on a single dedicated ETL server host that includes a Greenplum Database server installation.

About the Download Packages

The GPSS gppkg Installer and the GPSS tarball package files install the libraries, executables, and script files required to register and use the Greenplum Streaming Server client and server utilities directly into your Greenplum Database installation.

The GPSS ETL Installer package file installs the client side executables and dependent libraries, and a script to set up the ETL runtime environment.

Name	Description
gpkafka	Load Kafka data into Greenplum Database using a single command.
gpss	Start a VMware Greenplum Streaming Server instance.
gpsscli	Manage (submit, start, stop, and so forth) a VMware Greenplum Streaming Server data load job; currently supports Kafka, file, RabbitMQ, and S3 (Beta) data sources.
kafkacat	https://github.com/edenhill/kafkacat Kafka test and debug utility.

Downloading a GPSS Installer

Download the appropriate GPSS installer package for your Greenplum Database version and operating system platform from VMware Tanzu Network. For example, to download the Greenplum 6 .gppkg package for Red Hat/CentOS 7, click to select the RHEL7->GPSS gppkg Installer for GPDB6 RHEL7 file.

The naming format of the GPSS installer files is:

gpss-gpdb<major-version>-<gpss-version>-<platform>-x86_64.<filetype>

For example, the GPSS installer files for Greenplum Database 5 for Red Hat/CentOS 6 are named:

gpss-gpdb5-1.9.0-rhel6-x86_64.gppkg
gpss-gpdb5-1.9.0-rhel6-x86_64.tar.gz
gpss-gpdb5-1.9.0-rhel6-x86_64.rpm

The GPSS installer files for Greenplum Database 6 for Red Hat 8 are named:

gpss-gpdb6-1.9.0-rhel8-x86_64.gppkg
gpss-gpdb6-1.9.0-rhel8-x86_64.tar.gz
gpss-gpdb6-1.9.0-rhel8-x86_64.rpm

The GPSS installer files for Greenplum Database 6 for Photon 3 are named:

gpss-gpdb6-1.9.0-photon3-x86_64.gppkg
gpss-gpdb6-1.9.0-photon3-x86_64.tar.gz
gpss-gpdb6-1.9.0-photon3-x86_64.rpm

The GPSS installer files for Greenplum Database 6 for Ubuntu 18.04 are named:

gpss-gpdb6-1.9.0-ubuntu18.04-x86_64.gppkg
gpss-gpdb6-1.9.0-ubuntu18.04-x86_64.tar.gz
gpss-gpdb6-1.9.0-ubuntu18.04-x86_64.deb

Note the name and the file system location of the downloaded file.

Follow the instructions in Verifying the VMware Greenplum Software Download to verify the integrity of the Greenplum Streaming Server software.

Prerequisites

Before you install a GPSS package, ensure that you have stopped all Greenplum Streaming Server load jobs and gpss server instances running in the Greenplum Database cluster and on the ETL host system.

Installing the GPSS gppkg

The GPSS gppkg Installer updates the GPSS components on all hosts in the Greenplum Database cluster.

Note
The GPSS executables, libraries, and supporting files are installed directly into $GPHOME, overwriting the previous versions of the files.

Perform the following procedure to install the GPSS .gppkg:

Locate the installer file that you downloaded from VMware Tanzu Network and copy the file to the Greenplum Database master host.
Log in to the Greenplum Database master host as the gpadmin administrative user and set up your environment. For example:
```
$ ssh gpadmin@<gpmaster>
gpadmin@gpmaster$ . /usr/local/greenplum-db/greenplum_path.sh
```
Ensure that Greenplum Database is running.
Run the gppkg command to install the GPSS .gppkg on all hosts in the Greenplum Database cluster. For example, to install the package on a Greenplum 6 cluster running on Red Hat/CentOS 7:
```
$ gppkg -i gpss-gpdb6-1.9.0-rhel7-x86_64.gppkg
```

Installing the GPSS Tarball

The GPSS tarball .tar.gz installer updates the GPSS components on a single Greenplum Database host.

Note
The GPSS executables, libraries, and supporting files are installed directly into $GPHOME, overwriting the previous versions of the files.

Perform the following procedure to install the GPSS .tar.gz:

Locate the installer file that you downloaded from VMware Tanzu Network and copy the file to the Greenplum Database host.
Log in to the Greenplum Database host as the gpadmin administrative user and set up your environment. For example:
```
$ ssh gpadmin@<gphost>
gpadmin@gphost$ . /usr/local/greenplum-db/greenplum_path.sh
```
Unpack the .tar.gz file. For example, to unpack the file for Greenplum 5 on Red Hat/CentOS 6:
```
gpadmin@gphost$ tar xzvf gpss-gpdb5-1.9.0-rhel6-x86_64.tar.gz
```
Unpacking the file creates a directory named gpss-gpdb5-1.9.0-rhel6_x86_64/ in the current working directory. Its contents include bin/, lib/, and share/ directories, as well as an install script named install_gpdb_component.

Navigate to the unpacked directory. For example:

 gpadmin@gphost$ cd gpss-gpdb5-1.9.0-rhel6_x86_64

Run the install script to install the new GPSS components into $GPHOME. For example:
```
 gpadmin@gphost$ ./install_gpdb_component
```

Installing the GPSS ETL Package

The GPSS ETL Installer installs the GPSS executables, libraries, and supporting files on a single ETL host.

Perform the following procedure to install the GPSS ETL package:

Locate the installer file that you downloaded from VMware Tanzu Network and copy the file to the ETL host.
Log in to the ETL host. For example:
```
$ ssh <etluser>@<etlhost>
```
Install the package using your package management utility. You must be the superuser or have sudo access to install packages.

For example, to install the ETL package for Greenplum 6 on Red Hat/CentOS 7:
```
etluser@etlhost$ sudo yum install gpss-gpdb6-1.9.0-rhel7-x86_64.rpm
```
To install the ETL package for Greenplum 6 on Ubuntu 18.04:
```
etluser@etlhost$ sudo dpkg --install gpss-gpdb6-1.9.0-ubuntu18.04-x86_64.deb
```
The GPSS ETL tools are installed into the /usr/local/gpss-<version> directory. The installation process creates a symbolic link from /usr/local/gpss to this install directory.
Before using the GPSS ETL tools, you must first source the gpss_path.sh environment file:
```
etluser@etlhost$ . /usr/local/gpss/gpss_path.sh
```