BigQuery issue: Tables with unapplied upsert data cannot be queried through prefix.

[lethanhduong]

Describe the bug
We're using Datastream to ingest the data to BigQuery. After that, we collect the BigQuery metadata to Datahub.
However, The ingestion job got a issue when it try to query partition information of Datasets using DataStream flow.

Error Log
400 Tables with unapplied upsert data cannot be queried through prefix. First table with upsert data

Script Called
The template query is executed in this case
https://github.com/datahub-project/datahub/blob/master/metadata-ingestion/src/datahub/ingestion/source/bigquery_v2/queries.py#L72

[github-actions]

This issue is stale because it has been open for 30 days with no activity. If you believe this is still an issue on the latest DataHub release please leave a comment with the version that you tested it with. If this is a question/discussion please head to https://slack.datahubproject.io. For feature requests please use https://feature-requests.datahubproject.io