avatarChristianlauer

Summary

Google has introduced BigQuery Studio, a new feature aimed at simplifying data analysis and science tasks by integrating Python notebooks, asset management, and AI-powered assistive code development within the BigQuery environment.

Abstract

Google's BigQuery Studio, currently in preview, is designed to streamline the process of data discovery, exploration, analysis, and machine learning inference. It offers a suite of tools including a robust SQL editor with code completion and query validation, Colab Enterprise Python notebooks with BigQuery DataFrame support, and asset management with version history. The platform also incorporates assistive code development powered by Duet AI and Dataplex features for data discovery and quality checks. Users can transition seamlessly from BigQuery Studio to Vertex AI for more advanced machine learning tasks. This latest addition to Google's data warehouse suite reflects the company's ongoing commitment to enhancing its cloud services for data professionals.

Opinions

  • The author views the introduction of BigQuery Studio as a promising development, indicating Google's dedication to continuously improving its flagship SaaS data warehouse, BigQuery.
  • The author suggests that the new features are designed to support data analysts, scientists, and engineers in their daily tasks, implying that these enhancements are user-centric and aimed at increasing productivity.
  • The ability to export saved query results for use in other applications and connect to tools like Looker and Google Sheets is seen as a beneficial aspect of BigQuery Studio, highlighting its interoperability and versatility.
  • The frequent release of new features, such as JSON and quantitative like operator functions, as well as UDFs for exporting data as protocol buffer columns, is perceived positively by the author, showcasing Google's proactive approach to meeting the evolving needs of data professionals.

Google just launched BigQuery Studio

How the brand new Feature eases Data Analysis & Science Tasks

Photo by Vitalii Onyshchuk on Unsplash

Google has just stated that BigQuery Studio is now in preview. With BigQuery Studio, Google wants to make it easier for you to discover, explore, analyze, and run inference on data in BigQuery, including[1]:

Python notebooks, powered by Colab Enterprise. Notebooks provide one-click Python development runtimes, and built-in support for BigQuery DataFrames.

Asset management and version history for notebooks and saved queries, powered by Dataform.

If the feature is not available for you yet, it might be due to the fact that it’s in preview and you might use a free tier. However, down below you can see a GIF about how the whole will look when this feature is generally available.

BigQuery Studio in Preview — Image Source: Google[2]

BigQuery Studio shall enable users to discover, explore, analyze and predict data more easily. When using BigQuery Studio, you therefore can start in a programming notebook to validate and prep data, then open that notebook in other services, including Vertex AI, Google’s managed machine learning platform in order to continue their work with more specialized AI infrastructure and tooling[2][3].

According to Google, BigQuery Studio helps you to discover, analyze, and run inference on data in BigQuery with the following features:

A robust SQL editor that provides code completion, query validation, and estimation of bytes processed.

Colab Enterprise Python notebooks. Notebooks provide one-click Python development runtimes, and built-in support for BigQuery DataFrames.

Asset management and version history for code assets such as notebooks and saved queries, built on top of Dataform.

Assistive code development in the SQL editor and in notebooks, built on top of Duet AI generative AI.

Dataplex features for data discovery, and data profiling and data quality scans.

The ability to view job history.

The ability to analyze saved query results by connecting to other tools such as Looker and Google Sheets, and to export saved query results for use in other applications.

For me, this sounds very promising and shows again that Google is still striving to further equip its flagship SaaS Data Warehouse (or rather Lakehouse) with new features. In the past months, new features have been released again and again, which should support Data Analysts, Scientists and Engineers in their daily work.

Sources and Further Readings

[1] Google, BigQuery release notes (2023)

[2] Google, BigQuery Studio (2023)

[3] TechCrunch, Google launches BigQuery Studio, a new way to work with data (2023)

Data Science
Google
Bigquery
Technology
Business
Recommended from ReadMedium