Visual Spark Studio IDE For Spark Apps
Written by Kay Ewbank   
Thursday, 01 March 2018

A new free IDE has been released that lets you build, test and run Apache Spark apps on your desktop. Visual Spark Studio is a free cut-down version of the Impetus StreamAnalytix platform. It provides a lightweight development tool for data processing and analytics on Spark data.

Apache Spark is a general-purpose cluster computing framework, with native support for distributed SQL, streaming, graph processing, and machine learning.

sparkstudio

The new IDE can be used to build Spark apps for for both batch and streaming mode. It is a free, quick-start lightweight product that is a A Spark-only version of StreamAnalytix (an open-source enabled, enterprise-grade, stream processing and machine learning platform). Visual Spark Studio keeps the StreamAnalytix interface and has ready-to-use operators to select, drag-and-drop, connect, and configure connectors to create a fully functional Spark pipeline.

streamanal

The IDE can be used to receive data from a range of local data sources and data targets, and includes all the analytics and machine learning capabilities of StreamAnalytix on a single instance. There's also an option to export and scale out pipelines to a multi-node Spark cluster using the enterprise version of StreamAnalytix. 

Visual Spark Studio has drag-and-drop operators for data source, sink, transformation, and analytics, or you can use custom logic with Java and Scala operators. There's a pipeline designer for application development and built-in dashboards for real-time visualization of data. The data sources that you can write into include HDFS, Kafka, RDBMS, and Solr, and there are built in
operators for predictive models, Spark MLlib, ML and PMML for model-porting.
 

Visual Spark Studio is available for Windows, Linux and Mac, and while the aim of the developers is obviously to encourage you to move to StreamAnalytix, Spark Studio offers a useful way to get to grips with Spark and the concepts behind it.

 

sparkstudio

More Information

Visual Spark Studio Website

Related Articles

Spark Gets NLP Library

Apache Spark With Structured Streaming

Spark BI Gets Fine Grain Security

Spark 2.0 Released

Apache Spark Technical Preview

Spark Announcements

Apache Releases Spark 1.6

Spark 1.4 Released

SPARQL Moves Closer

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Visual Studio 17.12 Released Along With Aspire
25/11/2024

Visual Studio 2022 v17.12 is now available. The release can be used for .NET 9 projects and has a range of other improvements.



Azure Container Apps Dynamic Sessions Generally Available
02/12/2024

Dynamic Session support has been added to Azure Container Apps. Azure Container Apps is a serverless platform for running containerized applications, and dynamic sessions is designed to provide fast a [ ... ]


More News

espbook

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 01 March 2018 )