Apache Storm On Azure
Written by Kay Ewbank   
Thursday, 26 February 2015

Apache Storm,  a distributed real-time analytics system for Hadoop that can be used for processing large volumes of rapidly changing data, has been released on Microsoft Azure HDInsight.

stormonhdi

 

General availability of Storm comes as part of the latest update to HDInsight, alongside the news that HDInsight is now available on Linux.

The release has been described by Oliver Chiu on the Azure blog as being due to:

‘a natural decision to give customers the choice of running their big data Hadoop workloads on both Windows and Linux’,

presumably partially driven by the fact that 20 percent of Azure Virtual Machines run on Linux.

Apache Storm was made available in preview last October as clusters on HDInsight, and Microsoft is now announcing the general availability of Storm as a deployment option with the aim of making Hadoop easier to use. The release also includes support for Hadoop 2.6, new Virtual Machine sizes, cluster scaling, and built-in integration to Azure DocumentDB.

 

In this Channel 9 video in the Data Exposed series Asad Khan gives the background to the Azure Storm service and its latest features:

 

The most interesting aspect for developers is the fact that Storm is now available for both .NET and Java, and integration with Visual Studio allows you to work in VS on Storm apps.

 

stormvsint

 

This includes the ability to use Storm spouts and bolts written in other languages. Details of how to do this are included in and article Develop C# topologies for Apache Storm on HDInsight using Visual Studio that is part of the Microsoft Azure documentation. 

Microsoft is making use of the Hortonworks availability of HDP 2.2 to release the next version of HDInsight built on Hadoop 2.6, Hive and Pig. This version of HDInsight includes work done on Stinger.next to speed up Hadoop queries. The new version also includes cluster scaling in Azure HDInsight, so you can change the number of nodes of a running HDInsight cluster without having to delete and recreate a new cluster.  

stormsq

More Information

HDInsight

Related Articles

Apache Storm Added To Hadoop On Azure 

New Azure Services Announced 

Machine Learning Goes Azure - Azure ML Announced 

HDInsight - Brings Apache Hadoop to Windows 

 

To be informed about new articles on I Programmer, install the I Programmer Toolbar, subscribe to the RSS feed, follow us on, Twitter, FacebookGoogle+ or Linkedin,  or sign up for our weekly newsletter.

 

Banner


Pi Compute Module 4 - Time to Take Industrial Pi Seriously
20/10/2020

It's been a long wait, but at last the Raspberry Pi Compute Module 4 is available and it's quite a departure from earlier compute modules. Is this enough to get the Pi a place at the serious IoT table [ ... ]



IBM's Call For Code 2020 Winner - Agrolly
16/10/2020

IBM this week awarded the 2020 Call for Code grand prize of $200,000 to the creators of an app that helps small farmers threatened by climate change decide what to plant and w [ ... ]


More News

 

square

 



 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 26 February 2015 )