Streamline GSC Reporting with BigQuery and Dataform

Hello everyone,

I wanted to share the setup we use at my company to manage GSC data, in case it can inspire anyone. We’re quite proud of what we’ve built: simple, yet very effective.

Context:
We manage 10+ domains across 10+ markets, with over 1M clicks per day. All our GSC data has been stored in BigQuery since the bulk export feature became available.

Challenges:
We’re dealing with over 3TB of raw data, so using the default tables provided by Google for reporting isn’t feasible: queries would be slow, and costs would skyrocket.

Our setup:
We’ve implemented a lightweight yet powerful data transformation pipeline using Dataform (available for free within GCP). We can:

• Transform and clean the raw GSC data efficiently
• Create pre-aggregated, report-ready tables
• Keep everything version-controlled and automated via SQL and Git
• Triggers alerts based on conditions (YoY evolution, missing data ...)
The result: fast, cost-effective, and scalable reporting for all our domains. As a bonus, we own the data, therefore any change can be applied in minutes, not days (if you depend on the data team).

Happy to dive deeper or share more details if anyone’s interested!