Apache Kafka Adds New Streams API
Apache Kafka Adds New Streams API
Written by Kay Ewbank   
Thursday, 02 March 2017

A new version of Apache Kafka has been released, with a new Kafka Streams API for session windows, and improved compatibility for Java clients.  Apache Kafka is a distributed streaming platform that can be used for building real-time streaming data pipelines between systems or applications.

Alongside the new Streams API, other improvements to this release include improved compatibility for Java clients, improved semantics for Kafka Streams joins, and single message transforms in Kafka Connect.

Kafka was originally developed at LinkedIn, from where it was taken on as an Apache project. It is a fast, scalable, durable, and fault-tolerant publish-subscribe messaging system that can be used in place of traditional message brokers.

The work at Apache has concentrated on making Kafka work with Apache products including Storm, HBase and Spark for real-time analysis and rendering of streaming data.

Kafka was designed from the outset as a distributed system so it is easy to scale out. It supports multi-subscribers and automatically balances the consumers during failure.

kafka diagram

 

The new version of Kafka now has four core APIs. The Production API allows an application to publish a stream records to one or more Kafka topics.

The Consumer API allows an application to subscribe to one or more topics and process the stream of records produced to them.

The Connector API can be used for building and running reusable producers or consumers that connect Kafka topics to existing applications or data systems.

The new Streams API allows an application to act as a stream processor, consuming an input stream from one or more topics and producing an output stream to one or more output topics, effectively transforming the input streams to output streams.

 

 

kakfalogo

 

More Information

Kafka Website

Related Articles

Apache Beam Moves To Top Level

HBase Adds MultiWAL Support

Spark BI Gets Fine Grain Security

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on, Twitter, FacebookGoogle+ or Linkedin.

 

Banner


Top 10 From Around The Web: eCommerce Development
28/07/2017

eCommerce is the focus of this trawl around the web to bring you items of interest that you otherwise might not have found. We start with a look at integrating a payment gateway and continue with [ ... ]



Where To Find Top U.S. Developers
28/07/2017

You might imagine that California, where Silicon Valley is located and with the highest concentration of  software developers, would be the state with the United States' top coders. In fact, acco [ ... ]


More News

 

 
 

 

blog comments powered by Disqus

Last Updated ( Thursday, 02 March 2017 )
 
 

   
Banner
RSS feed of news items only
I Programmer News
Copyright © 2017 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.