|Apache Arrow 15 Stabilizes Flight SQL
|Written by Alex Denham
|Thursday, 25 January 2024
Apache Arrow 15 has been released. Improvements include new format strings in the C data interface, and Flight SQL now being stable in Arrow Flight.
The improvements to the new release start with the addition of new format strings for the C Data Interface. The additional format strings have been added for ListView, LargeListView, BinaryView and StringView array types.
Flight SQL is now considered stable for Arrow Flight RPC. Flight RPC is an RPC framework for high-performance data services based on Arrow data, and is built on top of gRPC and the IPC format. RPC (Remote Procedure Call) is a requestâ€“response protocol. One of the biggest features that sets apart Flight from other data transport frameworks is parallel transfers, allowing data to be streamed to or from a cluster of servers simultaneously. This enables developers to more easily create scalable data services that can serve a growing client base. The Flight SQL specification was also clarified in this release to specify how the result set schema of a prepared statement is affected by bound parameters. Another improvement means the JDBC Arrow Flight SQL driver now supports mTLS authentication and bind parameters. It can also reuse credentials across metadata and data connections.
C++ in Arrow has faster scalar encoding and decoding, and its Parquet support adds the ability for row group filtering for nested paths among other improvements.
The Java improvements include better handling of 256-bit decimals in the JDBC adapter, and the addition of a bill-of-materials package.
The developers say they expect a breaking change for Java in the next release, Apache 16. This will be due to the addition of support for Java 9 modules, which will require changing the JVM flags used to launch your application. Arrow 15.0.0 is not affected.
Apache Arrow 15 is available now.
or email your comment to: email@example.com
|Last Updated ( Thursday, 25 January 2024 )