About Spring Cloud Data Flow

Spring Cloud Data Flow is an open-source toolkit that can deploy streaming and batch data pipelines on Kubernetes. The data pipelines are composed of Spring Cloud Stream or Spring Cloud Task applications. A streaming pipeline DSL makes it easy to specify which apps to deploy and how to connect outputs and inputs. The composed task DSL is useful for when a series of task apps must be run as a directed graph.

Spring Cloud Data Flow provides REST APIs for composing and deploying data pipelines programmatically. It also provides a dashboard that includes a graphical pipeline editor for building new pipelines interactively, as well as views of deployable apps and running apps with metrics using Prometheus, InfluxDB, or other monitoring systems. Spring Cloud Data Flow also includes a shell application for working with the API from the command line.

About VMware Spring Cloud Data Flow for Kubernetes

VMware Spring Cloud^® Data Flow for Kubernetes (SCDF for Kubernetes) is based on the Spring Cloud Data Flow open source project. SCDF for Kubernetes orchestrates the deployment lifecycle of streaming and batch data pipelines deployed on Kubernetes. Data pipelines are composed of Spring Cloud Stream or Spring Cloud Task applications. You can use the streaming pipeline DSL and UI to specify which apps to deploy and how to connect outputs and inputs. When running a series of task applications as a directed graph, you can use the composed task DSL and UI.