New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support rebuilding a rolling window of multiple table partitions via Airflow #4783

Open

sean-rose opened this issue Jan 5, 2024 · 1 comment

Contributor

sean-rose commented Jan 5, 2024 •

edited by data-sync-user

Sometimes we need to rebuild more than just the latest partition (e.g. due to late arriving data).

┆Issue is synchronized with this Jira Task

Contributor Author

sean-rose commented Jan 5, 2024

Some examples of tables which could use this feature:

moz-fx-data-shared-prod.mozilla_vpn_derived.active_subscription_ids_v1
moz-fx-data-shared-prod.mozilla_vpn_derived.active_subscriptions_v1
moz-fx-data-shared-prod.mozilla_vpn_derived.subscription_events_v1
moz-fx-data-shared-prod.mozilla_vpn_derived.channel_group_proportions_v1
moz-fx-data-marketing-prod.ga_derived.www_site_metrics_summary_v2 (Add new DAG ga4_site_metrics_summary_backfill telemetry-airflow#1891)

scholtzan mentioned this issue

Event flows monitoring #4744

Merged

5 tasks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment