Influence Looker’s Roadmap and join the BI Customer Council (BICC)
Would you like to influence Google Cloud’s BI roadmap more? I’d like to invite you to join the Google Cloud BI...
Data Analytics
Want more from your data? Have questions about products like BigQuery, Dataflow, or Pub/Sub? You're in the right place. Join conversations around data warehouse modernization, streaming analytics, business intelligence, and more.
Focused on Looker? Engage with the Looker Community here.
Focused on Looker? Engage with the Looker Community here.
Forum Posts
Alerting or a Dashboard on long running query/jobs in big query
I would like setup and alert for long running queries/jobs lets if running beyond a threshold of 10 minutes. H...
Dataplex Business Glossary automatic mapping
Hello, I've been trying to find a solution to automatic mapping of terms in Dataplex Business Glossary. I want...
PII + Dataform in BigQuery – Anyone make this work securely?
Trying to leverage BigQuery Data Protection features (policy tags, dynamic masking) with Dataform, but hitting...
Aspect and Tags in Dataplex Catalog
please explain the key differences between using Aspects , Aspect Types and Tags , Tags Template in Dataplex C...
Setting to increase GCP Pub/Sub subscription send throughput
I am trying to figure out the source of latency in my application as I am seeing a number of un-acked messages...
MONGODB TO BIGQUERY - Connection and Transform
I'm new to data engineering and using MongoDB, so I'd like some help, please.I have a MongoDB database that ne...
Looker Studio with BigQuery data source does not show data, what permissions should it have?
Hi everybodyI have a Looker studio dashboard, with BigQuery data source.Dashboard sharing link settings is Pub...
Unable to Push to Bitbucket from Dataform via SSH
Hello,I am currently using Google Cloud Dataform to manage a Bitbucket repository via SSH.While SSH authentica...
Issue with Missing Tables During Google Ads Data Backfill in BigQuery
Hello,We are currently extracting Google Ads data into BigQuery. However, we encountered errors on certain sch...
BigQuery 400 Error - If default_project ID is set, it must be equal to default_dataset's project ID
Hello,I have been using Simba JDBC version 1.5.0 to connect to BigQuery. From March 27th of this year (2025), ...
BigQuery Storage Read select columns from sub-records typed ARRAY<STRUCT<...>>
I am using the BigQuery Read API and have a question on using SelectedFields.My data is of the shape {message_...
Query history in BigQuery
Hello everyone,Is it possible to see the query with which a table in BigQuery was created? I’ve tried checking...
Policy Tags
Hi,Is there any way to add Policy Tags on external tables in BigQuery?
How to increase the quota in my region for cpus
Urgently i want to increase my my quota limit for CPUs to 16 or 32 but in my region i have the limit for 8 onl...
Automate a daily data collection on BigQuery
Hi everyone! I have to report the sum of my app's users on a daily basis, but I struggle to automate it.The u...
Airflow not able to parallelize tasks with .expand() - GCP Composer 3
Hello,I was developing dag pipelines in Airflow with Composer 3 set-up. Everything was working fine even with ...
bigquery - on-demand vs enterprise edition auto-scaler
We're using on-demand bigQuery model exclusively for all our projects. my observation is that in on-demand mod...
PK and FK syntax to make my script idempotent
I have below script where I create or replace tables in my pipeline. I add PK and FK constraint after the tabl...
Run DataPlex Data Quality Scan Under Custom Service Account
Hello!We are using Dataplex Data Quality Scans in our project and have encountered a limitation related to ser...
Help Needed: Missing _metadata_uuid and _metadata_lsn in BigQuery Dataset for Datastream Pipeline
Hello everyone!I could really use some assistance!I've set up a pipeline to copy data from my managed SQL (Pos...
Issue with hyphen - in postgres db name
I am trying to transfer data from on premise Postgres dbs into big query. This works as expected for databases...
Bigquery internal Error
Hey All,I'm getting an internal Error:An internal error occurred and the request could not be completed. This ...
SQL runner visualization errors with pivots
I am getting an error anytime I try to graph data with a pivoted dimension in SQL runner. The visualization se...
Access Denied: BigQuery BigQuery: Permission denied while getting Drive credentials.
I am trying to read data from the external bigquery table (i.e. linked to google sheet) in apache beam pipelin...
Dashboard Looker Studio
I need assistance with a set of Looker Studio dashboards that I previously had access to, but which have recen...
PosgreSQL to BigQuery Connection
I can't seem to connect the PostgreSQL source to BigQuery using Data Transfer Service and/or Data StreamI alre...
Dataform Merge into table
i everyone,I'm currently trying to leverage Dataform's "incremental" function to perform a merge (upsert) oper...
Is it possible to set priority of dataform execution to BATCH
The default bigquery priority for dataform execution is set to INTERACTIVE. Is it possible to set them to BATC...
Dataflow Temp Files Not Being Deleted
I have multiple Dataflow jobs that run on a daily basis and pick up data from GCS, apply transformations, and ...
Sudden BigQuery “Quota exceeded: free query bytes scanned” error from Looker Studio
We’ve been using Looker Studio connected to BigQuery via Funnel for years with no issues. Starting April 9, 20...
Articles from Product Experts and Googlers
BigQuery Data Preparation with AI Agents: Smarter, faster, and code-free
Ready to unlock the secrets hidden in your product data? This tutorial demonstrates how BigQuery Data Preparation can clean and transform your raw data into actionable business intelligence, using a realistic example from the Fashion and Beauty industry.
Launched: ABAP SDK v1.10 unleashing powerful AI/ML, eventing, and storage capabilities
Supercharge your SAP systems! ABAP SDK v1.10 unlocks BigQuery AI/ML, simplified event-driven integration, Cloud Storage content repositories & access to 290+ Google Cloud APIs. See what's new.
From idea to viral video: the GenAI workflow you need
What if you could create professional-quality videos with just a fraction of the effort? This blog introduces a radical new GenAI workflow on Vertex AI, using models like Gemini, Imagen3, MusicLM and Veo2 etc to make video creation accessible to everyone.
