StreamBase Systems has released an integrated offering between its complex event processing (CEP) and LiveView business analytics products, and the Hadoop stack, for online, real-time analytics against streaming big data. The integration is based on Flume, a data collection network for Hadoop. The integration will provide a solution for online analytical applications, such as real-time fraud detection, real-time monitoring, and real-time social sentiment analysis.
Flume is a distributed, reliable, and highly available service for collecting, aggregating, and moving large amounts of log data into and out of Hadoop. It offers developers a simple extensible data model that allows for the creation of real-time analytic applications based on streaming data flows, with enterprise-class features such as fault tolerance and central management.
The Hadoop integration with StreamBase combines the power of Hadoop, Flume, CEP, and real-time analytics, by allowing Flume to use StreamBase CEP and LiveView as log event stream sinks for real-time processing, much in the way HDFS is a sink for the same data for batch processing.