Apache Arrow Improves C++ Support
Written by Kay Ewbank   
Monday, 08 February 2021

Apache Arrow is now at version 3.0. The updated release improves support for the Arrow columnar format specification, has overhauled authentication in C++, Java and Python, and has a number of other improvements to C++ support. New in this release is support for Julia.

Apache Arrow is a development platform for in-memory analytics. It has technologies that enable big data systems to process and move data fast..It is language independent, can be used for flat and hierarchical data, and the data store is organized for efficient analytic operations. It also provides computational libraries. Languages currently supported are C, C++, C#, Go, Java, JavaScript, Julia, MATLAB, Python, R, Ruby, and Rust.

arrow

The new release implements the Arrow columnar format in C++ and Java, and also has better support for Flight authentication in C++, Java and Python to permit more flexible authentication methods and use of standard headers. Support for cookies has also been added.

C++ memory management has also received work, so the default memory pool can now be changed at runtime. Threads in a thread pool are now spawned lazily as needed for enqueued tasks, up to the configured capacity.

C# improvements mean the .NET package now has initial support for Arrow Flight clients and servers.

The Rust support in Arrow has received a number of improvements in this release. The core Arrow crate has been improved for Rust developers, and all project crates, including Arrow, Parquet, and DataFusion, now build with stable Rust by default. The Parquet Writer for Arrow arrays is now available, so Rust programs can read and write Parquet files and it is easier to integrate with the overall Arrow ecosystem.

This is the first release to officially include an implementation for the Julia language. The pure Julia implementation includes support for wide coverage of the format specification.

arrow 

More Information

Apache Arrow Website

Arrow On GitHub

Related Articles

Apache Arrow 2 Improves C++ and Rust Support

Apache Arrow Reaches 1.0

Apache Arrow Flight Released

Apache Arrow Adds DataFusion Rust-Native Engine

Apache Arrow Adds Streaming Binary Format

Databricks Delta Adds Faster Parquet Import

Apache Kudu 1.9 Adds Location Awareness

Apache Kudu Improves Web Interface 

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Paul Allen's Living Computers Sold For Record Prices
04/10/2024

Auction house Christie's of New York broke existing records for sales of rare and iconic computers when it sold the collection that the late Paul Allen, co-founder of Microsoft, had assembled to  [ ... ]



Sequin - Open Source Message Stream Built On Postgres
31/10/2024

Sequin is a tool for capturing changes and streaming data out of your Postgres database, guaranteeing exactly once processing. What does that mean?


More News

espbook

 

Comments




or email your comment to: comments@i-programmer.info