Have Your Say On .NET For Spark
Written by Kay Ewbank   
Friday, 05 July 2019

Developers are being given the opportunity to decide how to improve .NET for Apache Spark. Spark is the general-purpose cluster computing framework that has native support for distributed SQL and enables streaming, graph processing, and machine learning. A survey is now open to help shape the future of the .NET for Spark product.

The .NET bindings for Spark were introduced earlier in the year at the Spark + AI Summit. Until their introduction Spark was accessible by coding using Scala, Java, Python or R but not .NET.

sparklogo

The .NET bindings are written on the Spark interop layer, and are designed to provide high performance bindings to multiple languages. One advantage of the bindings is that they are compliant with .NET Standard. This is a formal specification of .NET APIs that are common across .NET implementations, meaning that you can use .NET for Apache Spark anywhere you write .NET code.

The current version of .NET for Apache Spark has APIs for using Apache Spark from C# and F#. These support all areas of Spark including Spark SQL for working with structured data, and Spark Streaming.

.NET for Apache Spark is available by default in Azure HDInsight, and can be installed in Azure Databricks, Azure Kubernetes Service, AWS Databricks, and AWS EMR.

The new survey is designed to find out what experiences developers have had using the current release of .NET for Apache Spark, and what 'challenges' they've encountered. This will be used to see where the product can be improved. Questions in the survey ask what language you're currently using, and what kind of app in terms of cloud/mobile/desktop. Other questions cover the tools you're currently using to develop Spark, and the frameworks, libraries and cloud services you've used.

sparklogo 

More Information

Survey On .NET For Apache Spark

.NET For Apache Spark On GitHub

.NET For Apache Spark On Microsoft

Related Articles

Visual Spark Studio IDE For Spark Apps

.NET Is One With .NET 5

Spark BI Gets Fine Grain Security

Spark Announcements

Microsoft Asks For Help On The Future Of .NET - Where Do We Start?

Microsoft Open Sources .NET?       

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Ballerina Swan Lake Beta 2 Released
28/09/2021

The second beta of the new "Swan Lake" version of programming language Ballerina has been released. Swan Lake is designed to simplify how developers build and deploy cloud-native applications and this [ ... ]



Apple Increases Developer Support
25/10/2021

Apple is increasing its support for developers in two separate moves. The company has joined the Blender Development Fund as a Patron Member to support continued core development for Blender, and has  [ ... ]


More News

square

 



 

Comments




or email your comment to: comments@i-programmer.info