Mark Pollack

Mark Pollack

Mark Pollack is a software engineer with Pivotal and is the lead of the Spring Cloud Data Flow project. He has been a contributor to many Spring projects dating back to the Spring Framework in 2003 as well as founding the Spring.NET and Spring Data projects.

Recent Blog posts by Mark Pollack

Spring XD 1.3 RC1 released

Releases | November 03, 2015 | ...
On behalf of the Spring XD team, I am very pleased to announce the first release candidate of Spring XD 1.3 is now available for download. You can also install using brew and rpm. This release includes some major new functionality for batch jobs. We have introduced the ability to create composed jobs that allows you to create a complex graph of jobs executed based on a new Job DSL. Flo for Spring XD UI has been updated to support the new Job DSL and provide a visual drag and drop canvas for creating composed jobs. Spring XD’s job execution UI also supports execution history of composed…

Spring XD 1.3 M1 released

Releases | October 08, 2015 | ...
On behalf of the Spring XD team, I am very pleased to announce the first milestone release of Spring XD 1.3 This release includes bug fixes and some enhancements: Hadoop distribution version updates to Apache Hadoop 2.7.1 and Hortonworks Data Platform 2.3. Pivotal Hadoop 2.1, 3.0 and Cloudera Hadoop 5.4 Spark 1.3.1 Support Cassandra Sink Header Enricher Processor Bug fixes to the Flo Designer UI and Admin UI Gpfdist sink now supports update operations and full range of control file options Update to Spring Integration 4.2 which provides performance improvements when monitoring is enabled…

Spring XD 1.2.1 Released

Releases | July 28, 2015 | ...
On behalf of the Spring XD team, I am very pleased to announce the general availability of Spring XD 1.2.1! This release includes bug fixes and some small enhancements: Support for registering custom Kryo Serializers Configuration options to fine tune Kryo performance Update several dependencies to latest versions - Spring Integration, Boot, reactor, Groovy Add jars for Avro and Snappy compression to Sqoop job submission Fix admin UI access when security is enabled Improved pagination for containers and jobs You can download the zip distribution or install on OSX using homebrew On RHEL/CentOS…

Spring XD 1.2 GA, Spring XD 1.1.3 and Flo for Spring XD Beta released.

Releases | June 17, 2015 | ...
Today, we are pleased to announce the general availability of Spring XD 1.2, Spring XD 1.1.3 and the release of Flo for Spring XD Beta. 1.2.0.GA: zip 1.1.3.RELEASE: zip Flo for Spring XD Beta You can also install XD 1.2 using brew and rpm The 1.2 release includes a wide range of new features and improvements. The release journey was an eventful one, mainly due to Spring XD’s popularity with so many different groups, each with their respective request priorities. However the Spring XD team rose to the challenge and it is rewarding to look back and review the amount of innovation delivered to…

Spring XD 1.2 RC1 Released

Releases | June 02, 2015 | ...
On behalf of the Spring XD team, I am very pleased to announce that the Spring XD 1.2 Release Candidate is now available for download. You can also install using rpm The 1.2 RC1 release includes bug fixes as well as several new features and enhancements. Apache Ambari plugin to automate the deployment of Spring XD to a Hadoop cluster. Read more in the release blog for the plugin. A new Analytics tab in the UI that allows you to easily view gauges, counters, field-value counters and aggregate counters. Performance improvements for the Kafka Message Bus that places it on par with the…

Spring XD 1.2 M1 and 1.1.2 released

Releases | April 30, 2015 | ...
On behalf of the Spring XD team, I am very pleased to announce the first milestone release of Spring XD 1.2 and the 1.1.2 maintenance release. Download Links: 1.1.2.RELEASE: zip 1.2.0.M1: zip You can also install using brew and rpm The full list of issues fixed for 1.1.2 is available in JIRA. Of note the 1.1.2 release provides PHD 3.0 support. The 1.2 M1 release includes bug fixes as well and several new features and enhancements: PHD 3.0 support MongoDB Source, a community contribution from Abhinav Gandhi Module registry backed by HDFS Greenplum gpload as provided batch job. This allows…

Spring XD 1.1.1 Released

Releases | March 26, 2015 | ...
On behalf of the Spring XD team, I am very pleased to announce the first maintenance release of Spring XD 1.1. Download Link: 1.1.1.RELEASE: zip and brew. The 1.1.1 release includes bug fixes and some enhancements. The full list of tickets is available in our JIRA. Here are some highlights. Improved performance and offset management when using Kafka message bus. Support for Spark Streaming's reliable receiver. Kryo serialization improvements. Option to clean up Rabbit queue/topics when deleting the stream. Add a Sqoop example Feedback is very important, so please get in touch with questions…

Spring XD 1.1 GA and 1.0.4 released

Releases | February 12, 2015 | ...
Six months after the 1.0 GA release, the team is happy to announce the availability of Spring XD 1.1 GA. Download Links: 1.1.0.RELEASE: zip, homebrew, yum. 1.0.4.RELEASE: zip. Please read Sabby Anandan's blog for a general overview of Spring XD. Specific to 1.1, a ton of features have been added. Here are some that will give you the most bang for your big data buck. Stream Processing with Reactor, RxJava, Spark Streaming and Python Orchestrate Spark and Sqoop Batch Jobs Kafka based message bus, source and sink along with new general purpose high level Kafka APIs Batching and compression…

Spring XD 1.1 RC1 released

Engineering | January 29, 2015 | ...
On behalf of the Spring XD team, I am very pleased to announce that the Spring XD 1.1 Release Candidate is now available for download. The 1.1 RC1 release includes several new features as well as bug fixes. One theme in the 1.1 release is around Stream processing. The 1.1 M2 version introduced support for Reactor’s Stream API in processing modules. The 1.1 RC1 release adds support for stream processing using RxJava’s Observable API and Spark Streaming alongside the existing Spark job support. By providing a range of options, you can pick the functional programming model that best suits the…

Spring XD 1.1 M2 and 1.0.3 released

Engineering | December 23, 2014 | ...
On behalf of the Spring XD team, I am very pleased to announce the second milestone release of Spring XD 1.1 and the 1.0.3 maintenance release. Download Links: 1.1.0.M2 RELEASE: zip, 1.0.3.RELEASE: zip The 1.1 M2 release includes bug fixes and enhancements as well as several new features: Kafka based Message Bus. If Kafka is your middleware du jour, you will feel right at home. Batching and compression support for RabbitMQ provides significantly increased effective message rate throughput. Develop Processor modules using Project Reactor’s Stream API. The Stream API is based on the Reactive…

Get ahead

VMware offers training and certification to turbo-charge your progress.

Learn more

Get support

Tanzu Spring offers support and binaries for OpenJDK™, Spring, and Apache Tomcat® in one simple subscription.

Learn more

Upcoming events

Check out all the upcoming events in the Spring community.

View all