Visual Spark Studio IDE For Spark Apps
Visual Spark Studio IDE For Spark Apps
Written by Kay Ewbank   
Thursday, 01 March 2018

A new free IDE has been released that lets you build, test and run Apache Spark apps on your desktop. Visual Spark Studio is a free cut-down version of the Impetus StreamAnalytix platform. It provides a lightweight development tool for data processing and analytics on Spark data.

Apache Spark is a general-purpose cluster computing framework, with native support for distributed SQL, streaming, graph processing, and machine learning.

sparkstudio

The new IDE can be used to build Spark apps for for both batch and streaming mode. It is a free, quick-start lightweight product that is a A Spark-only version of StreamAnalytix (an open-source enabled, enterprise-grade, stream processing and machine learning platform). Visual Spark Studio keeps the StreamAnalytix interface and has ready-to-use operators to select, drag-and-drop, connect, and configure connectors to create a fully functional Spark pipeline.

streamanal

The IDE can be used to receive data from a range of local data sources and data targets, and includes all the analytics and machine learning capabilities of StreamAnalytix on a single instance. There's also an option to export and scale out pipelines to a multi-node Spark cluster using the enterprise version of StreamAnalytix. 

Visual Spark Studio has drag-and-drop operators for data source, sink, transformation, and analytics, or you can use custom logic with Java and Scala operators. There's a pipeline designer for application development and built-in dashboards for real-time visualization of data. The data sources that you can write into include HDFS, Kafka, RDBMS, and Solr, and there are built in
operators for predictive models, Spark MLlib, ML and PMML for model-porting.
 

Visual Spark Studio is available for Windows, Linux and Mac, and while the aim of the developers is obviously to encourage you to move to StreamAnalytix, Spark Studio offers a useful way to get to grips with Spark and the concepts behind it.

 

sparkstudio

More Information

Visual Spark Studio Website

Related Articles

Spark Gets NLP Library

Apache Spark With Structured Streaming

Spark BI Gets Fine Grain Security

Spark 2.0 Released

Apache Spark Technical Preview

Spark Announcements

Apache Releases Spark 1.6

Spark 1.4 Released

SPARQL Moves Closer

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on, Twitter, FacebookGoogle+ or Linkedin.

Banner


Hand Tracking With Nothing But A Webcam
09/06/2018

There have been hand trackers and they didn't really make much of an impression, but a hand tracker that uses just a webcam could be the breakthrough. Webcams are everywhere and the software could add [ ... ]



Official Discrimination In Britain's Computer Industry
27/05/2018

A book which uses as its sources recently opened government files, personal interview and the archives of major British computer companies reveals a shocking insight into the gender gap that still exi [ ... ]


More News

justjsquare

 



 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 01 March 2018 )
 
 

   
Banner
Banner
RSS feed of news items only
I Programmer News
Copyright © 2018 i-programmer.info. All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.