The Cloud Foundry Command Line Interface (cf CLI) lets you securely log into remote host virtual machines (VMs) running VMware Tanzu Application Service for VMs (TAS for VMs) app instances. The commands that enable SSH access to apps, and enable, deactivate, and check permissions for such access are described here.
Important The cf ssh
command in cf CLI v7+ include the all_proxy
environment variable, which allows you to specify a proxy server to activate proxying for all requests. For more information, see ssh in the Cloud Foundry CLI Reference Guide and Use SOCKS5 with cf v3-ssh in Using the cf CLI with a proxy server.
The cf CLI looks up the app_ssh_oauth_client
identifier in the Cloud Controller /v2/info
endpoint, and uses this identifier to query the UAA server for an SSH authorization code. On the target VM side, the SSH proxy contacts the Cloud Controller through the app_ssh_endpoint
listed in /v2/info
to confirm permission for SSH access.
NoteIf you have mutual TLS between the Gorouter and app containers, app containers accept incoming communication only from the Gorouter. This disables cf ssh
. For more information, see the TLS to apps and other back end services section of the HTTP routing topic.
cf CLI Command | Purpose |
---|---|
cf enable-ssh cf disable-ssh cf allow-space-ssh cf disallow-space-ssh |
Enable and Disable SSH Access |
cf ssh-enabled cf space-ssh-allowed |
Check SSH Access Permissions |
cf ssh |
Log Into an App Container with cf SSH |
cf ssh-code |
App SSH Access without cf CLI using non-cf SSH tools like ssh , scp , and sftp |
A cloud operator can deploy TAS for VMs to either allow or prohibit app SSH across the entire deployment. For more information, see Configuring SSH Access for TAS for VMs.
Within a deployment that permits SSH access to apps, Space Developers can enable or disable SSH access to individual apps, and Space Managers can enable or disable SSH access to all apps running within a space.
You must restart your app after enabling SSH access.
cf enable-ssh enables SSH access to all instances of an app:
$ cf enable-ssh MY-AWESOME-APP
cf disable-ssh disables SSH access to all instances of an app:
$ cf disable-ssh MY-AWESOME-APP
cf allow-space-ssh allows SSH access into all apps in a space:
$ cf allow-space-ssh SPACE-NAME
cf disallow-space-ssh disallows SSH access into all apps in a space:
$ cf disallow-space-ssh SPACE-NAME
cf ssh-enabled checks whether an app is accessible with SSH:
$ cf ssh-enabled MY-AWESOME-APP ssh support is disabled for 'MY-AWESOME-APP'
cf space-ssh-allowed checks whether all apps running within a space are accessible with SSH:
$ cf space-ssh-allowed SPACE-NAME ssh support is enabled in space 'SPACE-NAME'
If SSH access is allowed at the deployment, space, and app level, you can run the cf ssh APP-NAME
command to start an interactive SSH session with a VM hosting an app. By default, the command accesses the container running the first instance of the app, the instance with index 0.
$ cf ssh MY-AWESOME-APP
When logged into a VM hosting an app, you can use tools like the Cloud Foundry Diego Operator Toolkit (CFDOT) to run app status diagnostics. For more information, see How to use Cloud Foundry Diego Operator Toolkit (CFDOT) in the Knowledge Base.
You can tailor cf ssh commands with the following flags, most of which mimic flags for the Unix or Linux ssh
command. Run the cf ssh --help
command for more details.
The -i
flag targets a specific instance of an app. To log into the VM container hosting the third instance, index=2
, of MY-AWESOME-APP, run:
$ cf ssh MY-AWESOME-APP -i 2
The -L
flag enables local port forwarding, binding an output port on your machine to an input port on the app VM. Pass in a local port, and your app VM port and port number, all colon delimited. You can prepend your local network interface, or use the default localhost
.
$ cf ssh MY-AWESOME-APP -L [LOCAL-NETWORK-INTERFACE:]LOCAL-PORT:REMOTE-HOST-NAME:REMOTE-HOST-PORT
The -N
flag skips returning a command prompt on the remote machine. This sets up local port forwarding if you do not need to execute commands on the host VM.
The --process
flag in cf CLI v7 allows you to SSH into the container for a specific process running as part of your app.
The --request-pseudo-tty
and --force-pseudo-tty
flags let you run an SSH session in pseudo-tty mode rather than generate terminal line output.
If you want the environment of your interactive SSH session to match the environment of your buildpack-based app, with the same environment variables and working directory, run the following commands after starting the session:
/tmp/lifecycle/shell
After running the above command, the value of the VCAP_APPLICATION
environment variable differs slightly from its value in the environment of the app process, as it does not have the host
, instance_id
, instance_index
, or port
fields set. These fields are available in other environment variables, as described in VCAP_APPLICATION in TAS for VMs Environment Variables.
In addition to cf ssh
, you can use other SSH clients such as ssh
, scp
, or sftp
to access your app, if you have SSH permissions.
Follow one of the processes below to securely connect to an app instance by logging in with a specially-formed username that passes information to the SSH proxy running on the host VM. For the password, use a one-time SSH authorization code generated by cf ssh-code.
Query the /v2/info
endpoint of the Cloud Controller in your deployment. Record the domain name and port number of the app_ssh_endpoint
field, and the app_ssh_host_key_fingerprint
field. You will compare the app_ssh_host_key_fingerprint
with the fingerprint returned by the SSH proxy on your target VM. For example:
$ cf curl /v2/info { ... "app_ssh_endpoint": "ssh.example.com:2222", "app_ssh_host_key_fingerprint": "a6:14:c0:ea:42:07:b2:f7:53:2c:0b:60:e0:00:21:6c", ... }
In this example:
ssh.example.com
.2222
.a6:14:c0:ea:42:07:b2:f7:53:2c:0b:60:e0:00:21:6c
.Run the following command:
ssh -p PORT-NUMBER cf:$(cf curl /v3/apps/$(cf app APP-NAME --guid)/processes | jq -r '.resources[] | select(.type=="web") | .guid')/0@SSH-ENDPOINT
Where:
PORT-NUMBER
is the port number of the app_ssh_endpoint
field that you recorded in the previous step.APP-NAME
is the name of your target app.SSH-ENDPOINT
is the domain name of the app_ssh_endpoint
field that you recorded in theprevious step.For example:
ssh -p 2222 cf:$(cf curl /v3/apps/$(cf app my-app --guid)/processes | jq -r '.resources[] | select(.type=="web") | .guid')/[email protected]
Run cf ssh-code
to obtain a one-time authorization code that substitutes for an SSH password. You can run cf ssh-code | pbcopy
to automatically copy the code to the clipboard. For example:
$ cf ssh-code E1x89n
When the SSH proxy reports its RSA fingerprint, confirm that it matches the app_ssh_host_key_fingerprint
recorded above. When prompted for a password, paste in the authorization code returned by cf ssh-code
. For example:
$ ssh -p 2222 cf:abcdefab-1234-5678-abcd-1234abcd1234/0@ssh.MY-DOMAIN.com The authenticity of host '[ssh.example.com]:2222 ([203.0.113.5]:2222)' can't be established. RSA key fingerprint is a6:14:c0:ea:42:07:b2:f7:53:2c:0b:60:e0:00:21:6c. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '[ssh.example.com]:2222 [203.0.113.5]:2222' (RSA) to the list of known hosts. cf:d0a2e11d-e6ca-4120-b32d-140@ssh.ketchup.cf-app.com's password: vcap@ce4l5164kws:~$
You have now securely connected to the app instance.
Display the GUID of your target app by running:
cf app APP-NAME --guid`
Where APP-NAME
is the name of the app.
For example:
$ cf app my-app --guid abcdefab-1234-5678-abcd-1234abcd1234
Query the /v2/info
endpoint of the Cloud Controller in your deployment. Record the domain name and port number of the app_ssh_endpoint
field, and the app_ssh_host_key_fingerprint
field. You will compare the app_ssh_host_key_fingerprint
with the fingerprint returned by the SSH proxy on your target VM. For example:
$ cf curl /v2/info { ... "app_ssh_endpoint": "ssh.example.com:2222", "app_ssh_host_key_fingerprint": "a6:14:c0:ea:42:07:b2:f7:53:2c:0b:60:e0:00:21:6c", ... }
In this example:
ssh.example.com
.2222
.a6:14:c0:ea:42:07:b2:f7:53:2c:0b:60:e0:00:21:6c
.Run cf ssh-code
to obtain a one-time authorization code that substitutes for an SSH password. You can run cf ssh-code | pbcopy
to automatically copy the code to the clipboard. For example:
$ cf ssh-code E1x89n
Run your ssh
or other command to connect to the app instance.
SSH into the container hosting the first instance of your app by running the following command. For the username, use a string of the form cf:APP-GUID/APP-INSTANCE-INDEX@SSH-ENDPOINT
:
ssh -p `SSH-PORT` cf:APP-GUID/APP-INSTANCE-INDEX@SSH-ENDPOINT
Where:
SSH-PORT
is the port number recorded in earlier steps.APP-GUID
comes from the previous steps.APP-INSTANCE-INDEX
is the index of the instance that you want to access.SSH-ENDPOINT
comes from the previous steps and is in the form ssh.MY-DOMAIN.com
.For example:
$ ssh -p 2222 cf:abcdefab-1234-5678-abcd-1234abcd1234/0@ssh.example.com
Or you can use scp
to transfer files by running one of the following commands:
scp -P `SSH-PORT` -o User=cf:APP-GUID/APP-INSTANCE-INDEX ssh.MY-DOMAIN.com:REMOTE-FILE-TO-RETRIEVE LOCAL-FILE-DESTINATION
scp -P `SSH-PORT` -o User=cf:APP-GUID/APP-INSTANCE-INDEX LOCAL-FILE-TO-COPY ssh.MY-DOMAIN.com:REMOTE-FILE-DESTINATION
Or you can use ssh
piped with cat
command to transfer file by running:
cat local_file_path | cf ssh MY-AWESOME-APP -c "cat > remote_file_path"
When the SSH proxy reports its RSA fingerprint, confirm that it matches the app_ssh_host_key_fingerprint
recorded above. When prompted for a password, paste in the authorization code returned by cf ssh-code
, for example:
$ ssh -p 2222 cf:abcdefab-1234-5678-abcd-1234abcd1234/0@ssh.MY-DOMAIN.com The authenticity of host '[ssh.MY-DOMAIN.com]:2222 ([203.0.113.5]:2222)' can't be established. RSA key fingerprint is a6:14:c0:ea:42:07:b2:f7:53:2c:0b:60:e0:00:21:6c. Are you sure you want to continue connecting (yes/no)? yes Warning: Permanently added '[ssh.MY-DOMAIN.com]:2222 [203.0.113.5]:2222' (RSA) to the list of known hosts. cf:d0a2e11d-e6ca-4120-b32d-140@ssh.ketchup.cf-app.com's password: vcap@ce4l5164kws:~$
You have now securely connected to the app instance.
The SSH proxy has the following SSH security configuration by default:
Security Parameter | Values |
---|---|
Ciphers | [email protected] [email protected] aes256-ctr aes192-ctr aes128-ctr |
MACs | [email protected] hmac-sha2-256 |
Key Exchanges | [email protected] |
The cf ssh
command is compatible with this security configuration. If you use a different SSH client to access apps over SSH, you should ensure that you configure your client to be compatible with these ciphers, MACs, and key exchanges. For more information about other SSH clients, see App SSH Access without cf CLI above.
A second layer of SSH security runs within each container. When the SSH proxy attempts to handshake with the SSH daemon inside the target container, it uses the following fields associated with the diego-ssh
key in its route to the app instance. This inner layer works invisibly and requires no user action, but is described here to complete the SSH security picture.
container_port
indicates which port inside the container the SSH daemon is listening on. The proxy attempts to connect to host side mapping of this port after authenticating the client.
When present, host_fingerprint
declares the expected fingerprint of the SSH daemon’s host public key. When the fingerprint of the actual target’s host key does not match the expected fingerprint, the connection is terminated. The fingerprint should only contain the hex string generated by ssh-keygen -l
.
user
declares the user ID to use during authentication with the container’s SSH daemon. While this is not a required part of the routing data, it is required for password authentication and may be required for public key authentication.
password
declares the password to use during password authentication with the container’s ssh daemon.
private_key
declares the private key to use when authenticating with the container’s SSH daemon. If present, the key must be a PEM encoded RSA or DSA public key.
{
"process_guid": "ssh-process-guid",
"domain": "ssh-experiments",
"rootfs": "preloaded:cflinuxfs3",
"instances": 1,
"start_timeout": 30,
"setup": {
"download": {
"artifact": "diego-sshd",
"from": "http://file-server.service.cf.internal.example.com:8080/v1/static/diego-sshd/diego-sshd.tgz",
"to": "/tmp",
"cache_key": "diego-sshd"
}
},
"action": {
"run": {
"path": "/tmp/diego-sshd",
"args": [
"-address=0.0.0.0:2222",
"-authorizedKey=ssh-rsa ..."
],
"env": [],
"resource_limits": {}
}
},
"ports": [ 2222 ],
"routes": {
"diego-ssh": {
"container_port": 2222,
"private_key": "PEM encoded PKCS#1 private key"
}
}
}
To be accessible through the SSH proxy, containers must host an SSH daemon, expose it through a mapped port, and advertise the port in a diego-ssh
route. If a proxy cannot find the target process or a route, user authentication fails.
"routes": {
"diego-ssh": { "container_port": 2222 }
}
The Diego system generates the appropriate process definitions for TAS for VMs apps which reflect the policies that are in effect.