Spring XD 1.1 RC1 发布
Spring XD 1.1 RC1 发布,此版本现已提供下载, 包括一些新特性和 bug 修复,主要是 Stream 处理。Spring XD 1.1. M2 中处理模块引入了对 Reactor 的 Stream API 的支持。在 1.1 RC1 支持使用 RxJava 的 Observable API 和 Spark Streaming(支持现有的 Spark job)进行流处理。通过提供一系列的选项,你可以选择最适合任务的函数式编程模块。
Spark Streaming 集成特性如下:
-
XD Processor modules that act as drivers for workloads on the Spark Cluster.
-
An XD processor’s input DStream is generated from data received on the XD Message Bus, and the RDDs from its output DStream are sent to the bus.
-
The Spark Streaming driver process is automatically restarted if it dies due to the inherent module redeployment features of XD.
-
Simplify development and testing of Spark applications by decoupling your Spark computation code from code to setup input and output data.
RxJava 集成特性如下:
-
Development of processor modules using RxJava’s Observable API
-
Support for mapping input messages to one or multiple Observerble Stream instances
-
Refer to the rxjava-moving-average project for an example of using RxJava’s Observable API.
其他特性
-
Refactored Kafka Based Message Bus and Kafka Source based on the new Spring Integration Kafka client library.
-
Gemfire source and sink support for multiple locators.
-
Improved tooling and updated examples for custom module development.
相关链接:
-
StackOverflow
spring-xd
tag
更多内容请看发行说明。
Spring XD 是一个统一的,分布式,可扩展的系统用于数据摄取,实时分析,批量处理和数据导出。该项目的目标是简化大数据应用的开发。
来自:http://www.oschina.net/news/59217/spring-xd-1-1-rc1