Apache Storm On Azure
Written by Kay Ewbank   
Thursday, 26 February 2015

Apache Storm,  a distributed real-time analytics system for Hadoop that can be used for processing large volumes of rapidly changing data, has been released on Microsoft Azure HDInsight.

stormonhdi

 

General availability of Storm comes as part of the latest update to HDInsight, alongside the news that HDInsight is now available on Linux.

The release has been described by Oliver Chiu on the Azure blog as being due to:

‘a natural decision to give customers the choice of running their big data Hadoop workloads on both Windows and Linux’,

presumably partially driven by the fact that 20 percent of Azure Virtual Machines run on Linux.

Apache Storm was made available in preview last October as clusters on HDInsight, and Microsoft is now announcing the general availability of Storm as a deployment option with the aim of making Hadoop easier to use. The release also includes support for Hadoop 2.6, new Virtual Machine sizes, cluster scaling, and built-in integration to Azure DocumentDB.

 

In this Channel 9 video in the Data Exposed series Asad Khan gives the background to the Azure Storm service and its latest features:

 

The most interesting aspect for developers is the fact that Storm is now available for both .NET and Java, and integration with Visual Studio allows you to work in VS on Storm apps.

 

stormvsint

 

This includes the ability to use Storm spouts and bolts written in other languages. Details of how to do this are included in and article Develop C# topologies for Apache Storm on HDInsight using Visual Studio that is part of the Microsoft Azure documentation. 

Microsoft is making use of the Hortonworks availability of HDP 2.2 to release the next version of HDInsight built on Hadoop 2.6, Hive and Pig. This version of HDInsight includes work done on Stinger.next to speed up Hadoop queries. The new version also includes cluster scaling in Azure HDInsight, so you can change the number of nodes of a running HDInsight cluster without having to delete and recreate a new cluster.  

stormsq

More Information

HDInsight

Related Articles

Apache Storm Added To Hadoop On Azure 

New Azure Services Announced 

Machine Learning Goes Azure - Azure ML Announced 

HDInsight - Brings Apache Hadoop to Windows 

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, FacebookGoogle+ or Linkedin,  or sign up for our weekly newsletter.

 

Banner


Angular and Wiz To Merge
27/03/2024

Two web development frameworks used at Google are merging. One, Angular is open source and widely known, while the other, Wiz, is an internal web framework developed and used by Google for some o [ ... ]



White House Urges Memory Safe Software
29/02/2024

The White House is urging developers to adopt memory safe programming languages, suggesting Rust would be a safer choice than C or C++. 


More News

 

raspberry pi books

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 26 February 2015 )