Apache Ignite Changes SQL Engine
Written by Kay Ewbank   
Thursday, 05 May 2022

Apache Ignite has been updated to use a new SQL engine based on Apache Calcite, and new 'read repair' strategies.

Ignite can be used as a traditional SQL database via JDBC drivers, ODBC drivers, or its own native SQL APIs. By default, it runs purely in-memory, but clusters can be configured to run on a mix of disk and memory. It supports co--located compute in Java, Scala, Kotlin, C#, and C++.

ignite

Apache Calcite is s a dynamic data management framework.It contains many of the pieces that comprise a typical database management system, but omits some key functions: storage of data, algorithms to process data, and a repository for storing metadata. Calcite includes a SQL parser, an API for building expressions in relational algebra, and a query planning engine.

The new experimental SQL engine based on Apache Calcite aims to remove some of the limitations of the existing H2 SQL engine, and to optimize the execution of some queries.

The current H2-based engine has fundamental limitations, including a limit on query splitting to two phases - map subquery and reduce subquery. H2's optimizer is also not written to work in a distributed environment, and the creators of H2 often decline Ignite-specific changes to the H2 code.

The Apache Calcite is a SQL engine with customizable modules, and query requests can be split into more than two phases.

Another improvement to the new version is to the read repair strategies. Read repair refers to the task of repairing inconsistencies between primary and backup copies of data during normal read operations. The new read repair strategies can be set to one of a number of options, including LWW (Last Write Wins), the value from the primary node wins. and values found more often than any other wins. Users can also choose to remove inconsistent entries.

Apache Ignite 2.13 is available now. ignite

More Information

Apache Ignite Website

Apache Calcite Website

Related Articles

Apache Ignite Adds Change Data Capture

Apache Ignite Adds Spark DataFrames Support

Spark 3 Improves Python and SQL Support

Apache Superset Reaches Top Level Project Status

Apache Daffodil Now Top Level Project

Facebook Apollo NoSQL Database 

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


AWS Lambda Upgraded To .NET8 Runtime
25/03/2024

An upgrade of AWS Lambda to the .NET version 8 runtime
brings major improvements to the platform.



Microsoft Introduces .NET Smart Components
01/04/2024

Microsoft has provided a set of .NET Smart Components, described as a set of genuinely useful AI-powered UI components that you can quickly and easily add to .NET apps. The components are prebuilt end [ ... ]


More News

raspberry pi books

 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Thursday, 05 May 2022 )