GCP · Data & Analytics

BigQuery

Serverless petabyte-scale data warehouse.

Official docs

Overview

BigQuery runs SQL across columnar storage, supports streaming inserts, ML and federated queries.

When to use it

Analytics on test telemetry
Flaky-test detection
Long-term metric retention

Setup

Enable BigQuery API.
Create dataset and table (or auto-detect schema).

How to use

Load JUnit metrics

bq load --source_format=NEWLINE_DELIMITED_JSON qa.runs gs://qa-reports/runs/*.json

Find flaky tests

SELECT name, COUNTIF(status='fail')/COUNT(*) AS fail_rate
FROM qa.runs
WHERE day > CURRENT_DATE() - 30
GROUP BY name HAVING fail_rate BETWEEN 0.05 AND 0.5

QA use cases

Detect flakiness, measure trend regressions, build exec dashboards in Looker Studio.