Google Builds Data Lake On BigQuery
Written by Kay Ewbank   
Thursday, 07 April 2022

Google has launched BigLake, a data platform built on Google BigQuery and Dataplex that can be used for data analysis for both structured and unstructured data

The BigLake team says it gives users fine-grained access controls, along with performance acceleration across BigQuery and multicloud data lakes on AWS and Azure. BigLake also makes that data uniformly accessible across Google Cloud and open source engines with consistent security.

bigquery

Google BigQuery is a distributed, serverless SQL engine that provides a way to query petabytes of data. It has built in machine learning, is serverless, and supported by Google Cloud. Dataplex is described as "an intelligent data fabric that unifies your distributed data to help automate data management and power analytics at scale." It was introduced by Google in 2021, and in BigLake is used to automatically scan Google Cloud storage to register BigLake table definitions in BigQuery, and makes them available via Dataproc Metastore.

BigLake works by using access delegation to deal with the problem of accessing the data without needing direct access to the underlying cloud storage data. Access delegation can be used to securely grant row and column level access to users and pipelines without having to provide full access to the table by using BigQuery to enforce the row and column level access controls.

BigLake means BigQuery can now be used with multicloud data lakes and open formats such as Parquet and ORC with fine-grained security controls. The integration with Dataplex means you can keep a single copy of data and enforce consistent access controls across analytics engines including Google Cloud and open-source technologies such as Spark, Presto, Trino, and Tensorflow.

Google BigLake is available now.

 bigquery

 

 

 

More Information

Google BigLake Website

Google BigQuery

Related Articles

 Google BigQuery Updated

BigQuery Updated and Repriced

Google BigQuery Updated

BigQuery Now Open to All

Google BigQuery Service

 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on Twitter, Facebook or Linkedin.

Banner


Imagine Cup World Champions 2022
29/05/2022

Team V Bionic from Saudi Arabia was crowned the Imagine Cup World Champions at Microsoft Build. Just before the winning team was announced it was revealed that, in honor of it being the 20th Anniversa [ ... ]



It Pays To Get Certification
22/06/2022

The Open Source Jobs Report 2022, published today, reinforces the message that gaining certification is very worthwhile for developers. Meanwhile the Stack Overflow Developer Survey 2022, also publish [ ... ]


More News

pythondata

 



 

Comments




or email your comment to: comments@i-programmer.info