Mark Pollack

Mark Pollack

Mark Pollack is a software engineer with Pivotal and is the lead of the Spring Cloud Data Flow project. He has been a contributor to many Spring projects dating back to the Spring Framework in 2003 as well as founding the Spring.NET and Spring Data projects.

Recent Blog posts by Mark Pollack

Spring Cloud Data Flow 1.2 GA released

Releases | May 15, 2017 | ...
On behalf of the team, I am pleased to announce the general availability of Spring Cloud Data Flow 1.2 across a range of platforms Here are the relevant links to documentation and getting started guides. Local: Quick Start, Getting Started Guide Cloud Foundry: Getting Started Guide YARN: Getting Started Guide Kubernetes: Getting Started Guide Highlights of the 1.2 release: Composed Tasks This release introduces Composed Tasks ! This feature provides the ability to orchestrate a flow of tasks as a cohesive unit-of-work. A complex ETL pipeline may include executions in sequence, parallel…

Spring Cloud Data Flow 1.2 RC1 released

Releases | April 20, 2017 | ...
On behalf of the team, I am pleased to announce the first release candidate of Spring Cloud Data Flow 1.2. Note: A great way to start using this new release is to follow the Getting Started Guide in the reference documentation. Highlights of the 1.2 RC1 release: Composed Tasks This release introduces Composed Tasks ! This feature provides the ability to orchestrate a flow of tasks as a cohesive unit-of-work. A complex ETL pipeline may include executions in sequence, parallel, conditional transitions, or a combination of all of the above. The composed task feature comes with DSL primitives and…

Spring Cloud Data Flow 1.1 GA released

Releases | November 23, 2016 | ...
On behalf of the team, I am pleased to announce the GA release of Spring Cloud Data Flow 1.1. Follow the links in the getting started guide to download the local server implementation and shell to create Stream and Tasks. General highlights of the 1.1 GA Release include: Builds upon Spring Boot 1.4, Spring Cloud Camden SR2, Spring Integration 4.3 and Spring Cloud Task 1.1 release improvements. Adds LDAP, Basic and File based backend authentication Improvements to OAUTH backed authentication LDAP authentication is now supported with SSL Adds a form-based login page for non-OAUTH backend…

Spring Cloud Data Flow 1.1 RC1 Released

Releases | November 09, 2016 | ...
On behalf of the team, I am pleased to announce the first release candidate of Spring Cloud Data Flow 1.1. Follow the links in the getting started guide to download the local server implementation and shell to create Stream and Tasks. The 1.1 RC1 release includes the following new features and improvements: Builds upon Camden.SR2 release improvements LDAP authentication is now supported with SSL Portable deployment properties for memory and cpu are in place for support across various runtime implementations Passing Java Options to the local JVM when launching application is now supported UI…

Spring Cloud Data Flow 1.1 M2 Released

Engineering | October 18, 2016 | ...
On behalf of the team, I am pleased to announce the release of the second milestone of Spring Cloud Data Flow 1.1. You can download the local server that is part of this release here. The 1.1 M2 release includes the following new features and improvements: Builds upon Boot 1.4.1 and Spring Cloud Camden improvements Task application properties can now be referenced using non-prefixed property names Add visual representation for related streams. This representation also includes nested TAPs and the downstream processing nodes in an overall topology view. Visualization of Taps The UI adds bulk…

Spring Cloud Data Flow 1.0 GA released

Releases | July 12, 2016 | ...
On behalf of the team, I’m excited to announce the 1.0 GA release of Spring Cloud Data Flow! Note A great way to start using this new release is to follow the Getting Started section of the reference documentation. It uses a Data Flow server that runs on your computer and deploys a new process for each application. Spring Cloud Data Flow (SCDF) is an orchestration service for data microservices on modern runtimes. SCDF lets you describe data pipelines that can either be composed of long lived streaming applications or short lived task applications and then deploys these to platform runtimes…

Spring Cloud Data Flow 1.0 RC1 released

Releases | June 21, 2016 | ...
On behalf of the team I am pleased to announce the release of Spring Cloud Data Flow 1.0 RC1. Several exciting new features have been added in this release which carry over to the other Data Flow Server implementations that were also released today. Data Flow Local Server Data Flow for Cloud Foundry Data Flow for Apache YARN Data Flow for Kubernetes Data Flow for Apache Mesos Follow the links above for details on features unique to each individual runtime platform. The highlights of the release are: Spring Flo is now an open source project and has been integrated into the Spring Cloud Data…

Spring XD 1.3.1 GA and Flo for Spring XD 1.0.1 GA released

Releases | February 24, 2016 | ...
Today we are pleased to announce the general availability of Spring XD 1.3.1 and Flo for Spring XD 1.0.1 Spring XD 1.3.1 GA: zip, brew and rpm. Flo for Spring XD 1.0.1 GA: zip. Here are some highlights of bug fixes and general improvements. Consult the JIRA release notes for the full list of issues fixed. Support for encryption in XD configuration files Support for Kafka sync or async producers Fix for Embedded Headers Message Converter Buffer Overflow Update default redis pool settings to have no limit on number of active connections Upgrade to Spring Integration 4.2.5, Spring Framework 4.…

Spring Cloud Stream 1.0 M3 and Data Flow 1.0 M2 released

Releases | December 29, 2015 | ...
On behalf of the team, I am pleased to announce several releases in the Spring Cloud Stream and Spring Cloud Data Flow family of projects. Spring Cloud Stream 1.0 M3 introduces the following features Many improvements in middleware binding. In particular for supporting multiple binders, so you can now have RabbitMQ as an input and Kafka be the output, for example. Partitioning improvements Spring Cloud Stream Modules 1.0 M2 adds many new modules with updated documentation. Sources: File, Load Generator, sftp, and tcp Processors: httpclient, PMML, and Splitter Sinks: Cassandra, Field Value…

Spring XD 1.3 GA and Flo for Spring XD 1.0 GA released

Engineering | November 19, 2015 | ...
Today we are pleased to announce the general availability of Spring XD 1.3 and Flo for Spring XD 1.0. Spring XD 1.3 GA: zip, brew and rpm. Flo for Spring XD 1.0 GA: zip. In addition to bug fixes we have also added several new features in the 1.3 release line Job Composition DSL allows for the creation of a complex graph of job executions. Flo for Spring XD designer supports creating composed jobs. Admin UI supports execution history of composed jobs. Cassandra Sink and Header Enricher Processor Gpfdist sink now supports update operations and full range of control file options Spark 1.3.…

Get ahead

VMware offers training and certification to turbo-charge your progress.

Learn more

Get support

Tanzu Spring offers support and binaries for OpenJDK™, Spring, and Apache Tomcat® in one simple subscription.

Learn more

Upcoming events

Check out all the upcoming events in the Spring community.

View all