GCP Scenario
Mobile Automation Matrix with Firebase Test Lab
Per-PR Android matrix tests on real devices; results streamed to BigQuery; merge gated in Cloud Build.
Architecture
Cloud Build (on PR) ─► gradle assembleDebug + assembleAndroidTest
─► gcloud firebase test android run (matrix: 4 devices)
─► results in GCS + Firebase console
─► Cloud Function parses summary → BigQuery
─► Pub/Sub blocks merge until passServices used
Steps
- 1. Build APKs
Cloud Build produces app + test APKs.
- 2. Matrix run
Test Lab runs Espresso on 4 device profiles in parallel with video + perf capture.
- 3. Aggregate
Function parses Test Lab GCS results and writes per-device rows to BigQuery.
- 4. Gate
Pub/Sub message updates GitHub commit status; merge blocked on failure or perf regression.
Takeaways
- Real-device automation as a hard merge gate.
- Historical data enables device-specific flake and perf detection.
