New Quotas for Omni, more Sources for Data Transfer Service

More Power for Google BigQuery Omni

How Google makes platform-independent Data Analysis more powerful

Google released some interesting updates to its Data Warehouse flagship BigQuery last week.

Let’s start with the slightly smaller good surprise. Here, Google has provided the Data Transfer Service with new connectors, so that you can now also load data from Google Ads API via ETL or ELT into Google BigQuery. This should please data engineers in particular, who may now have fewer other tools and can do this with the easy to use and in the Google Cloud already well integrated with BigQuery solution Data Transfer Service.

If you don’t know it yet or you are interested in the topic and you want to read how to implement whole ELT processes with the service, the article below might be interesting for you.

Another interesting innovation should be the new features for quotas in BigQuery Omni. With BigQuery Omni you have the possibility to analyze external data sources e.g. based on Amazon or Azure Cloud via SQL. Just a few months ago, Google also released the Google BigLake tool (built on Omni) for this purpose. Now Google offers its customers to analyze more data. Omni now supports the following quotas and limits [1]:

• The quota for total query result sizes for a project is now 1 TB per day.
• The limit for maximum result size for a query has been increased from 2 GB to 10 GB.

Google has thus equipped its Data Warehouse with more power and more data sources and is likely to further advance platform-independent data analysis and establish BigQuery as a modern data platform that can serve as a Data Lakehouse and Data Mesh. Other useful and recent features in BigQuery are:

Sources and Further Readings

[1] Google, BigQuery release notes (2022)