On behalf of the Spring XD team, I am very pleased to announce the first milestone release of Spring XD 1.1 and the 1.0.2 maintenance release. Download Links: 1.0.2.RELEASE: zip, 1.1.0.M1 RELEASE: zip In addition to bug fixes, Spring XD 1.0.2 now supports Apache Hadoop 2.5.1. Pivotal PHD 2.1 and Cloudera CDH 5.1.3. The 1.1 M1 release includes bug fixes and enhancements as well as several new features: Run a Spark Application as a batch job Python based processors and sinks Kafka source and sink HDFS sink supports writing to a Kerberized Hadoop Cluster LDAP Authentication Modules can be…

On behalf of the Spring XD team, I am very pleased to announce the general availability of Spring XD 1.0.1! This release includes bug fixes and enhancements as well as some new features: HTTPS access and Authentication to Admin Server Cluster and Stream views in UI Configure a location for custom modules Null sink You can download the zip distribution or install on OSX using homebrew. On RHEL/CentOs you can install using yum. Feedback is very important, so please get in touch with questions and comments via StackOverflow spring-xd tag Spring JIRA or GitHub Issues

On behalf of the Spring XD team, I am very pleased to announce the general availability of Spring XD 1.0! You can download the zip distribution. You can also install on OSX using homebrew and on RHEL/CentOs using yum. Spring XD's goal is to be your one stop shop for developing and deploying Big Data Applications. Such applications require a wide range of technologies to address different use-cases while interoperating as a cohesive process. The steps in this process include: Data collection Real-time streaming and analytics Data cleansing Batch processing (both on and off Hadoop) Machine…

The Spring XD team is pleased to announce that Spring XD Release Candidate 1 is now available for download. You can also install Spring XD on OSX using homebrew and on RHEL/CentOs using yum. Highlights of this release Direct binding: Deployments can be configured to avoid modules sending data over the Message Bus if they are co-located in the same container. Using this option increases throughput and lowers latency but can not be applied to all deployment topologies. Stream Deployment State: The state of stream is calculated throughout the lifetime of the deployment. For example, if a…

The Spring XD team is pleased to announce that Spring XD Milestone 7 is now available for download. Highlights of this release Transport Data Partitioning: By default, messages are delivered to multiple instances of a stream module in a round-robin manner. However, if a module performs operations such that it can not consume random messages from the stream, then you can partition the stream based on its content so that similar messages are always delivered to the same module instance. For example, if a processing module is performing stateful operations on a per-customer basis, the stream…

The Spring XD team is pleased to announce that Spring XD Milestone 6 is now available for download. This is our biggest release yet! The team has been hard at work, and Milestone 6 contains a wealth of new features that meet enterprise requirements in terms of reliability, performance, and user experience. Below is a quick Top Ten (in no particular order), but if you checkout the release notes you will realize how difficult it is to pick out 10 from the list of 299. Distributed and Fault Tolerant Runtime: Leader election among multiple xd-admin servers and automatic redeployment of modules to…

We are pleased to announce the release of Spring Shell 1.1 RC1. The Spring Shell is an interactive shell that can be easily extended with commands using a Spring based programming model. This is a small bug fix release but includes an important improvement, the upgrade to use the JLine2 library and rewrite of the command parser. Check the release notes for more information. Special thanks to Eric Bottard and to those who submitted pull-requests. Downloads | JavaDocs | Reference Documentation | Changelog

The Spring XD team is pleased to announce that Spring XD 1.0.0 Milestone 5 is now available for download. Spring XD makes it easy to solve common big data problems such as data ingestion and export, real-time analytics, and batch workflow orchestration. This release includes several notable new features: Pre-defined batch jobs for JDBC to HDFS Many additional job shell commands for controlling and reporting on batch jobs. Hadoop Dataset Avro sink that uses the Kite SDK HDFS sink now supports codecs (gzip, snappy, bzip2, lzo) and fine-grained control over file naming JMS source module now…

Today we are pleased to announce the 1.0 M2 release of Spring XD (download)  Spring XD is a unified, distributed, and extensible system for data ingestion, real time analytics, batch processing, and data export.  The project’s goal is to simplify the development of big data applications. The second milestone release of Spring XD introduces several new features that make it even easier to ingest and process real-time streams of data as well as orchestrate Hadoop based batch jobs.  In this blog post we will cover Shell New sources, sinks and transports DSL improvements Batch Jobs Start…

Dear Spring Community, I am pleased to announce the first milestone release Spring Shell 1.1. Spring Shell is an interactive shell that can be easily extended with commands using a Spring based programming model. This release adds support for testing of commands as well as several bug fixes and general improvements. Many thanks to to those who submitted pull-requests Downloads | JavaDocs | Reference Documentation | Changelog We look forward to your feedback on the forum or in the issue tracker.