Google Extends BigQuery For Multi-Cloud Analytics
Written by Kay Ewbank   
Monday, 20 July 2020

Google has extended BigQuery for use with multiple clouds. BigQuery Omni works with Google Cloud and AWS, and will soon support Azure. 

Google BigQuery is a distributed, serverless SQL engine that provides a way to query petabytes of data. It has built-in machine learning, is serverless, and already supported Google Cloud.

BigQuery Omni is based on Google Cloud Anthos, a hybrid and multi-cloud application platform. Anthos handles the connection between Google Cloud and the other public clouds.

bigquery

Google Anthos is designed to provide a way to build, deploy, and manage applications anywhere in a secure, consistent manner. It can be used to run managed Kubernetes on both cloud and on-premises environments, with support for Google Cloud, Amazon Web Services (AWS) and Microsoft Azure. It consists of Anthos GKE, a container orchestration and management service for running Kubernetes clusters anywhere; Anthos Config Management for defining, automating and enforcing policies; Anthos Service Mesh for securing and managing traffic between services; and Anthos security that handles the actual security across clouds and hybrid deployments.

bigqueryomni

The Anthos clusters used to run BigQuery Omini are fully managed by Google Cloud. Anthos was used to build, deploy, and manage the BigQuery query engine (Dremel) on multiple clouds.

Until now, BigQuery could only be used with data stored in Google Cloud. BigQuery Omni changes this so users work in the BigQuery interface on Google Cloud, but can query data on other clouds without having to move any data across clouds or make any copies of data. BigQuery Omni’s query engine runs the computations on clusters in the same region where your data resides.

One example given was using BigQuery Omni to query Google Analytics 360 Ads data that’s stored in Google Cloud, and also querying logs data from an e-commerce platform and applications that are stored in AWS S3.

BigQuery Omni is currently in private alpha. If you’re interested in trying it out, fill out this form.

bigquery

More Information

BigQuery Omni Blog Post

Google BigQuery

Google Anthos

Related Articles

BigQuery Updated and Repriced

Google BigQuery Updated

BigQuery Now Open to All

Google BigQuery Service 

To be informed about new articles on I Programmer, sign up for our weekly newsletter, subscribe to the RSS feed and follow us on, Twitter, Facebook or Linkedin.

Banner


js1024 - How Much Awesomeness Can You Pack In Just 1K?
06/08/2020

js1024 is the continuation of the legendary js1k JavaScript golfing competition which ended last year and like its predecessor is planned to be an annual contest. The winners of the first one  ha [ ... ]



The Unreasonable Effectiveness Of GPT-3
05/08/2020

I suppose you say that the unreasonable effectiveness of OpenAI's GPT language program is just a special case of the unreasonable effectiveness of Deep Learning but ... it is so much more shocking.


More News

graphics

 



 

Comments




or email your comment to: comments@i-programmer.info

Last Updated ( Monday, 20 July 2020 )