AD-310 Backfill last 30 days of event aggregates #5597

curtismorales · 2024-05-16T16:28:03Z

Checklist for reviewer:

Commits should reference a bug or github issue, if relevant (if a bug is referenced, the pull request should include the bug number in the title).
If the PR comes from a fork, trigger integration CI tests by running the Push to upstream workflow and provide the <username>:<branch> of the fork as parameter. The parameter will also show up
in the logs of the manual-trigger-required-for-fork CI task together with more detailed instructions.
If adding a new field to a query, ensure that the schema and dependent downstream schemas have been updated.
When adding a new derived dataset, ensure that data is not available already (fully or partially) and recommend extending an existing dataset in favor of creating new ones. Data can be available in the bigquery-etl repository, looker-hub or in looker-spoke-default.

For modifications to schemas in restricted namespaces (see CODEOWNERS):

Follow the change control procedure

┆Issue is synchronized with this Jira Task

dataops-ci-bot · 2024-05-16T16:48:08Z

Integration report for "Backfill last 30 days of event aggregates"

`sql.diff`

Click to expand!

diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/dags/bqetl_marketing_suppression_list.py /tmp/workspace/generated-sql/dags/bqetl_marketing_suppression_list.py
--- /tmp/workspace/main-generated-sql/dags/bqetl_marketing_suppression_list.py	2024-05-16 16:32:05.000000000 +0000
+++ /tmp/workspace/generated-sql/dags/bqetl_marketing_suppression_list.py	2024-05-16 16:46:32.000000000 +0000
@@ -216,9 +216,5 @@
     )
 
     marketing_suppression_list_external__send_suppression_list_update_to_campaign_monitor__v1.set_upstream(
-        marketing_suppression_list_derived__main_suppression_list__v1
-    )
-
-    marketing_suppression_list_external__send_suppression_list_update_to_campaign_monitor__v1.set_upstream(
         marketing_suppression_list_external__campaign_monitor_suppression_list__v1
     )
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_suggest_v1: backfill.yaml
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_v1: backfill.yaml
Only in /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod: marketing_campaign_names
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_page/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_page/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_page/schema.yaml	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_page/schema.yaml	2024-05-16 16:30:08.000000000 +0000
@@ -41,7 +41,7 @@
   type: STRING
   mode: NULLABLE
   description: |-
-    Description of the localized site language and/or country based on `localized_site_language_code` (if any).
+    Localized site description based on `localized_site_language` and `localized_site_country` (if any).
     This will be null for anonymized Discover impressions.
 - name: localized_site_language_code
   type: STRING
@@ -55,6 +55,18 @@
   description: |-
     Localized site language based on `localized_site_language_code` (if any).
     This will be null for anonymized Discover impressions.
+- name: localized_site_country_code
+  type: STRING
+  mode: NULLABLE
+  description: |-
+    Localized site country code in ISO-3166-1-alpha-2 format found in the first segment of the page URL path (if any).
+    This will be null for anonymized Discover impressions.
+- name: localized_site_country
+  type: STRING
+  mode: NULLABLE
+  description: |-
+    Localized site country based on `localized_site_country_code` (if any).
+    This will be null for anonymized Discover impressions.
 - name: query
   type: STRING
   mode: NULLABLE
@@ -113,14 +125,6 @@
   description: |-
     Country from which the user was searching.
     This will be null for anonymized Discover impressions.
-- name: user_region
-  type: STRING
-  mode: NULLABLE
-  description: Region from which the user was searching.
-- name: user_subregion
-  type: STRING
-  mode: NULLABLE
-  description: Sub-region from which the user was searching.
 - name: device_type
   type: STRING
   mode: NULLABLE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_page/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_page/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_page/view.sql	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_page/view.sql	2024-05-16 16:30:08.000000000 +0000
@@ -97,6 +97,11 @@
     localized_site_language.name,
     search_impressions.localized_site_language_code
   ) AS localized_site_language,
+  search_impressions.localized_site_country_code,
+  COALESCE(
+    localized_site_country.name,
+    search_impressions.localized_site_country_code
+  ) AS localized_site_country,
   search_impressions.query,
   mozfun.google_search_console.classify_site_query(
     search_impressions.site_domain_name,
@@ -109,8 +114,6 @@
   search_impressions.search_appearance,
   search_impressions.user_country_code,
   COALESCE(user_country.name, search_impressions.user_country_code) AS user_country,
-  user_country.region_name AS user_region,
-  user_country.subregion_name AS user_subregion,
   search_impressions.device_type,
   search_impressions.impressions,
   search_impressions.clicks,
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_site/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_site/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_site/schema.yaml	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_site/schema.yaml	2024-05-16 16:30:08.000000000 +0000
@@ -49,14 +49,6 @@
   type: STRING
   mode: NULLABLE
   description: Country from which the user was searching.
-- name: user_region
-  type: STRING
-  mode: NULLABLE
-  description: Region from which the user was searching.
-- name: user_subregion
-  type: STRING
-  mode: NULLABLE
-  description: Sub-region from which the user was searching.
 - name: device_type
   type: STRING
   mode: NULLABLE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_site/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_site/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_site/view.sql	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/google_search_console/search_impressions_by_site/view.sql	2024-05-16 16:30:08.000000000 +0000
@@ -72,8 +72,6 @@
   search_impressions.search_type,
   search_impressions.user_country_code,
   COALESCE(user_country.name, search_impressions.user_country_code) AS user_country,
-  user_country.region_name AS user_region,
-  user_country.subregion_name AS user_subregion,
   search_impressions.device_type,
   search_impressions.impressions,
   search_impressions.clicks,
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/users_services_daily_v1/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/users_services_daily_v1/query.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/users_services_daily_v1/query.sql	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/users_services_daily_v1/query.sql	2024-05-16 16:30:08.000000000 +0000
@@ -19,18 +19,7 @@
   (SELECT COUNT(DISTINCT x) FROM UNNEST(arr) AS x)
 );
 
-WITH events_unnested AS (
-  SELECT
-    e.* EXCEPT (events),
-    event.timestamp AS event_timestamp,
-    CONCAT(event.category, "_", event.name) AS event_name,
-    event.extra AS event_extra
-  FROM
-    `moz-fx-data-shared-prod.accounts_backend.events` AS e
-  CROSS JOIN
-    UNNEST(e.events) AS event
-),
-fxa_events AS (
+WITH fxa_events AS (
   SELECT
     submission_timestamp,
     metrics.string.account_user_id_sha256 AS user_id_sha256,
@@ -41,9 +30,9 @@
     ) AS service,
     metrics.string.session_flow_id AS flow_id,
     metrics.string.session_entrypoint AS entrypoint,
-    event_name,
+    metrics.string.event_name AS event_name,
     -- `access_token_checked` events are triggered on traffic from RP backend services and don't have client's geo data
-    IF(event_name != 'access_token_checked', metadata.geo.country, NULL) AS country,
+    IF(metrics.string.event_name != 'access_token_checked', metadata.geo.country, NULL) AS country,
     metrics.string.utm_term AS utm_term,
     metrics.string.utm_medium AS utm_medium,
     metrics.string.utm_source AS utm_source,
@@ -51,12 +40,12 @@
     metrics.string.utm_content AS utm_content,
     metadata.user_agent,
   FROM
-    events_unnested
+    `accounts_backend.accounts_events`
   WHERE
     DATE(submission_timestamp)
     BETWEEN DATE_SUB(@submission_date, INTERVAL 1 DAY)
     AND @submission_date
-    AND event_name IN (
+    AND metrics.string.event_name IN (
       'access_token_checked',
       'access_token_created',
       -- registration and login events used when deriving the first_seen table
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/braze_derived/subscriptions_map_v1/script.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/braze_derived/subscriptions_map_v1/script.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/braze_derived/subscriptions_map_v1/script.sql	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/braze_derived/subscriptions_map_v1/script.sql	2024-05-16 16:30:08.000000000 +0000
@@ -123,14 +123,6 @@
     'mozilla-and-you'
   ),
   (
-    'mozilla-builder',
-    'Mozilla Builder newsletter',
-    '7e8d71f9-2e26-4308-ac0f-05a591cbae5a',
-    '1825ad87-9b63-45e4-b0ae-92c2e38feace',
-    '74435f4a-e25e-41bb-973a-a769179e05a0',
-    'mozilla-builder'
-  ),
-  (
     'mozilla-innovation',
     'Innovation Newsletter',
     '39fcaf11-2926-4366-b756-2c02e65cbce7',
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/contextual_services/event_aggregates/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services/event_aggregates/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/contextual_services/event_aggregates/schema.yaml	2024-05-16 16:28:33.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services/event_aggregates/schema.yaml	2024-05-16 16:40:33.000000000 +0000
@@ -1,49 +1,49 @@
 fields:
-- mode: NULLABLE
-  name: submission_date
+- name: submission_date
   type: DATE
-- mode: NULLABLE
-  name: source
+  mode: NULLABLE
+- name: source
   type: STRING
-- mode: NULLABLE
-  name: event_type
+  mode: NULLABLE
+- name: event_type
   type: STRING
-- mode: NULLABLE
-  name: form_factor
+  mode: NULLABLE
+- name: form_factor
   type: STRING
-- mode: NULLABLE
-  name: country
+  mode: NULLABLE
+- name: country
   type: STRING
-- mode: NULLABLE
-  name: subdivision1
+  mode: NULLABLE
+- name: subdivision1
   type: STRING
-- mode: NULLABLE
-  name: advertiser
+  mode: NULLABLE
+- name: advertiser
   type: STRING
-- mode: NULLABLE
-  name: release_channel
+  mode: NULLABLE
+- name: release_channel
   type: STRING
-- mode: NULLABLE
-  name: position
+  mode: NULLABLE
+- name: position
   type: INTEGER
-- mode: NULLABLE
-  name: provider
+  mode: NULLABLE
+- name: provider
   type: STRING
-- mode: NULLABLE
-  name: match_type
+  mode: NULLABLE
+- name: match_type
   type: STRING
-- mode: NULLABLE
-  name: normalized_os
+  mode: NULLABLE
+- name: normalized_os
   type: STRING
-- mode: NULLABLE
-  name: suggest_data_sharing_enabled
+  mode: NULLABLE
+- name: suggest_data_sharing_enabled
   type: BOOLEAN
-- mode: NULLABLE
-  name: event_count
+  mode: NULLABLE
+- name: event_count
   type: INTEGER
-- mode: NULLABLE
-  name: user_count
+  mode: NULLABLE
+- name: user_count
   type: INTEGER
-- mode: NULLABLE
-  name: query_type
+  mode: NULLABLE
+- name: query_type
   type: STRING
+  mode: NULLABLE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/contextual_services/event_aggregates_suggest/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services/event_aggregates_suggest/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/contextual_services/event_aggregates_suggest/schema.yaml	2024-05-16 16:28:33.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services/event_aggregates_suggest/schema.yaml	2024-05-16 16:40:33.000000000 +0000
@@ -1,40 +1,40 @@
 fields:
-- mode: NULLABLE
-  name: submission_date
+- name: submission_date
   type: DATE
-- mode: NULLABLE
-  name: form_factor
+  mode: NULLABLE
+- name: form_factor
   type: STRING
-- mode: NULLABLE
-  name: country
+  mode: NULLABLE
+- name: country
   type: STRING
-- mode: NULLABLE
-  name: advertiser
+  mode: NULLABLE
+- name: advertiser
   type: STRING
-- mode: NULLABLE
-  name: normalized_os
+  mode: NULLABLE
+- name: normalized_os
   type: STRING
-- mode: NULLABLE
-  name: release_channel
+  mode: NULLABLE
+- name: release_channel
   type: STRING
-- mode: NULLABLE
-  name: position
+  mode: NULLABLE
+- name: position
   type: INTEGER
-- mode: NULLABLE
-  name: provider
+  mode: NULLABLE
+- name: provider
   type: STRING
-- mode: NULLABLE
-  name: match_type
+  mode: NULLABLE
+- name: match_type
   type: STRING
-- mode: NULLABLE
-  name: suggest_data_sharing_enabled
+  mode: NULLABLE
+- name: suggest_data_sharing_enabled
   type: BOOLEAN
-- mode: NULLABLE
-  name: impression_count
+  mode: NULLABLE
+- name: impression_count
   type: INTEGER
-- mode: NULLABLE
-  name: click_count
+  mode: NULLABLE
+- name: click_count
   type: INTEGER
-- mode: NULLABLE
-  name: query_type
+  mode: NULLABLE
+- name: query_type
   type: STRING
+  mode: NULLABLE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_suggest_v1/backfill.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_suggest_v1/backfill.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_suggest_v1/backfill.yaml	1970-01-01 00:00:00.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_suggest_v1/backfill.yaml	2024-05-16 16:30:09.000000000 +0000
@@ -0,0 +1,8 @@
+2024-05-15:
+  start_date: 2024-04-16
+  end_date: 2024-05-15
+  reason: Backfilling mobile suggest data (recently added to this table)
+  watchers:
+  - cmorales@mozilla.com
+  - sbetancourt@mozilla.com
+  status: Initiate
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_v1/backfill.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_v1/backfill.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_v1/backfill.yaml	1970-01-01 00:00:00.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/contextual_services_derived/event_aggregates_v1/backfill.yaml	2024-05-16 16:30:09.000000000 +0000
@@ -0,0 +1,8 @@
+2024-05-15:
+  start_date: 2024-04-16
+  end_date: 2024-05-15
+  reason: Backfilling mobile suggest data (recently added to this table)
+  watchers:
+  - cmorales@mozilla.com
+  - sbetancourt@mozilla.com
+  status: Initiate
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/fenix/funnel_retention_clients/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/fenix/funnel_retention_clients/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/fenix/funnel_retention_clients/schema.yaml	2024-05-16 16:28:33.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/fenix/funnel_retention_clients/schema.yaml	2024-05-16 16:38:53.000000000 +0000
@@ -26,6 +26,9 @@
 - name: adjust_network
   type: STRING
   mode: NULLABLE
+- name: install_source
+  type: STRING
+  mode: NULLABLE
 - name: retained_week_2
   type: BOOLEAN
   mode: NULLABLE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/fenix/funnel_retention_week_4/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/fenix/funnel_retention_week_4/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/fenix/funnel_retention_week_4/schema.yaml	2024-05-16 16:28:33.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/fenix/funnel_retention_week_4/schema.yaml	2024-05-16 16:38:52.000000000 +0000
@@ -48,6 +48,10 @@
   description: 'The type of source of a client installation.
 
     '
+- name: install_source
+  type: STRING
+  mode: NULLABLE
+  description: null
 - name: new_profiles
   type: INTEGER
   mode: NULLABLE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/internet_outages/global_outages_v1/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/internet_outages/global_outages_v1/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/internet_outages/global_outages_v1/schema.yaml	2024-05-16 16:28:33.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/internet_outages/global_outages_v1/schema.yaml	2024-05-16 16:40:12.000000000 +0000
@@ -1,49 +1,49 @@
 fields:
-- mode: NULLABLE
-  name: country
+- name: country
   type: STRING
-- mode: NULLABLE
-  name: city
+  mode: NULLABLE
+- name: city
   type: STRING
-- mode: NULLABLE
-  name: datetime
+  mode: NULLABLE
+- name: datetime
   type: TIMESTAMP
-- mode: NULLABLE
-  name: proportion_undefined
+  mode: NULLABLE
+- name: proportion_undefined
   type: FLOAT
-- mode: NULLABLE
-  name: proportion_timeout
+  mode: NULLABLE
+- name: proportion_timeout
   type: FLOAT
-- mode: NULLABLE
-  name: proportion_abort
+  mode: NULLABLE
+- name: proportion_abort
   type: FLOAT
-- mode: NULLABLE
-  name: proportion_unreachable
+  mode: NULLABLE
+- name: proportion_unreachable
   type: FLOAT
-- mode: NULLABLE
-  name: proportion_terminated
+  mode: NULLABLE
+- name: proportion_terminated
   type: FLOAT
-- mode: NULLABLE
-  name: proportion_channel_open
+  mode: NULLABLE
+- name: proportion_channel_open
   type: FLOAT
-- mode: NULLABLE
-  name: avg_dns_success_time
+  mode: NULLABLE
+- name: avg_dns_success_time
   type: FLOAT
-- mode: NULLABLE
-  name: missing_dns_success
+  mode: NULLABLE
+- name: missing_dns_success
   type: FLOAT
-- mode: NULLABLE
-  name: avg_dns_failure_time
+  mode: NULLABLE
+- name: avg_dns_failure_time
   type: FLOAT
-- mode: NULLABLE
-  name: missing_dns_failure
+  mode: NULLABLE
+- name: missing_dns_failure
   type: FLOAT
-- mode: NULLABLE
-  name: count_dns_failure
+  mode: NULLABLE
+- name: count_dns_failure
   type: FLOAT
-- mode: NULLABLE
-  name: ssl_error_prop
+  mode: NULLABLE
+- name: ssl_error_prop
   type: FLOAT
-- mode: NULLABLE
-  name: avg_tls_handshake_time
+  mode: NULLABLE
+- name: avg_tls_handshake_time
   type: FLOAT
+  mode: NULLABLE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/asa_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/asa_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/asa_v1/metadata.yaml	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/asa_v1/metadata.yaml	1970-01-01 00:00:00.000000000 +0000
@@ -1,2 +0,0 @@
-description: Extract fields from ASA v1 campaign name
-friendly_name: Asa V1
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/asa_v1/udf.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/asa_v1/udf.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/asa_v1/udf.sql	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/asa_v1/udf.sql	1970-01-01 00:00:00.000000000 +0000
@@ -1,53 +0,0 @@
-CREATE OR REPLACE FUNCTION marketing_campaign_names.asa_v1(campaign_name STRING)
-RETURNS ARRAY<STRUCT<key STRING, value STRING>> AS (
-  IF(
-    NOT (
-      REGEXP_CONTAINS(campaign_name, r'^asa_v1')
-      AND ARRAY_LENGTH(SPLIT(campaign_name, "_")) = 14
-    ),
-    NULL,
-    ARRAY(
-      SELECT AS STRUCT
-        keys[off] AS key,
-        value
-      FROM
-        UNNEST(SPLIT(campaign_name, "_")) AS value
-        WITH OFFSET off,
-        (
-          SELECT
-            [
-              'ad_network',
-              'version',
-              'product',
-              'iniative',
-              'region',
-              'country_code',
-              'city',
-              'language',
-              'device',
-              'operating_system',
-              'campaign_type',
-              'campaign_goal',
-              'campaign_group',
-              'bidding_type'
-            ] AS keys
-        )
-    )
-  )
-);
-
-SELECT
-  mozfun.assert.equals(
-    ARRAY_LENGTH(
-      marketing_campaign_names.asa_v1(
-        'asa_v1_monitorPlus_challengeTheDefault_expansion_pl_all_pl_mobile_android_search_conversion_brand_cpi'
-      )
-    ),
-    14
-  ),
-  mozfun.assert.null(marketing_campaign_names.asa_v1('asa_v1_123')),
-  mozfun.assert.null(
-    marketing_campaign_names.asa_v1(
-      'gads_v1_monitorPlus_challengeTheDefault_expansion_pl_all_pl_mobile_android_search_conversion_brand_cpi'
-    )
-  ),
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/google_ads_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/google_ads_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/google_ads_v2/metadata.yaml	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/google_ads_v2/metadata.yaml	1970-01-01 00:00:00.000000000 +0000
@@ -1,2 +0,0 @@
-description: Extract fields from Google Ads v2 campagign names
-friendly_name: Google Ads V2
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/google_ads_v2/udf.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/google_ads_v2/udf.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/google_ads_v2/udf.sql	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/google_ads_v2/udf.sql	1970-01-01 00:00:00.000000000 +0000
@@ -1,57 +0,0 @@
-CREATE OR REPLACE FUNCTION marketing_campaign_names.google_ads_v2(campaign_name STRING)
-RETURNS ARRAY<STRUCT<key STRING, value STRING>> AS (
-  IF(
-    NOT (
-      REGEXP_CONTAINS(campaign_name, r'^gads_v2')
-      AND ARRAY_LENGTH(SPLIT(campaign_name, "_")) = 18
-    ),
-    NULL,
-    ARRAY(
-      SELECT AS STRUCT
-        keys[off] AS key,
-        value
-      FROM
-        UNNEST(SPLIT(campaign_name, "_")) AS value
-        WITH OFFSET off,
-        (
-          SELECT
-            [
-              'ad_network',
-              'version',
-              'product',
-              'iniative',
-              'region',
-              'country_code',
-              'city',
-              'audience',
-              'language',
-              'device',
-              'operating_system',
-              'campaign_type',
-              'campaign_goal',
-              'campaign_group',
-              'bidding_type',
-              'optimization_goal',
-              'ad_gap_id',
-              'po'
-            ] AS keys
-        )
-    )
-  )
-);
-
-SELECT
-  mozfun.assert.equals(
-    ARRAY_LENGTH(
-      marketing_campaign_names.google_ads_v2(
-        'gads_v2_monitorPlus_challengeTheDefault_expansion_pl_all_ypt_pl_mobile_android_appCampaign_conversion_search_tcpa_install_id123_po#123456789'
-      )
-    ),
-    18
-  ),
-  mozfun.assert.null(marketing_campaign_names.google_ads_v2('gads_v2_123')),
-  mozfun.assert.null(
-    marketing_campaign_names.google_ads_v2(
-      'asa_v2_monitorPlus_challengeTheDefault_expansion_pl_all_ypt_pl_mobile_android_appCampaign_conversion_search_tcpa_install_id123_po#123456789'
-    )
-  ),
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/meta_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/meta_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/meta_v2/metadata.yaml	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/meta_v2/metadata.yaml	1970-01-01 00:00:00.000000000 +0000
@@ -1,2 +0,0 @@
-description: Meta V2 campaign name extractor
-friendly_name: Meta V2
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/meta_v2/udf.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/meta_v2/udf.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/meta_v2/udf.sql	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_campaign_names/meta_v2/udf.sql	1970-01-01 00:00:00.000000000 +0000
@@ -1,56 +0,0 @@
-CREATE OR REPLACE FUNCTION marketing_campaign_names.meta_v2(campaign_name STRING)
-RETURNS ARRAY<STRUCT<key STRING, value STRING>> AS (
-  IF(
-    NOT (
-      REGEXP_CONTAINS(campaign_name, r'^meta_v2')
-      AND ARRAY_LENGTH(SPLIT(campaign_name, "_")) = 17
-    ),
-    NULL,
-    ARRAY(
-      SELECT AS STRUCT
-        keys[off] AS key,
-        value
-      FROM
-        UNNEST(SPLIT(campaign_name, "_")) AS value
-        WITH OFFSET off,
-        (
-          SELECT
-            [
-              'ad_network',
-              'version',
-              'product',
-              'iniative',
-              'region',
-              'country_code',
-              'city',
-              'language',
-              'device',
-              'operating_system',
-              'campaign_type',
-              'campaign_goal',
-              'campaign_group',
-              'bidding_type',
-              'optimization_goal',
-              'ad_gap_id',
-              'po'
-            ] AS keys
-        )
-    )
-  )
-);
-
-SELECT
-  mozfun.assert.equals(
-    ARRAY_LENGTH(
-      marketing_campaign_names.meta_v2(
-        'meta_v2_monitorPlus_challengeTheDefault_expansion_pl_all_pl_mobile_android_poll_consideration_search_cpi_install_id123_po#123456789'
-      )
-    ),
-    17
-  ),
-  mozfun.assert.null(marketing_campaign_names.meta_v2('meta_v2_123')),
-  mozfun.assert.null(
-    marketing_campaign_names.meta_v2(
-      'gads_v2_monitorPlus_challengeTheDefault_expansion_pl_all_pl_mobile_android_poll_consideration_search_cpi_install_id123_po#123456789'
-    )
-  ),
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_suppression_list_external/send_suppression_list_update_to_campaign_monitor_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_suppression_list_external/send_suppression_list_update_to_campaign_monitor_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_suppression_list_external/send_suppression_list_update_to_campaign_monitor_v1/metadata.yaml	2024-05-16 16:30:14.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_suppression_list_external/send_suppression_list_update_to_campaign_monitor_v1/metadata.yaml	2024-05-16 16:43:40.000000000 +0000
@@ -16,8 +16,6 @@
   depends_on:
   - task_id: marketing_suppression_list_external__campaign_monitor_suppression_list__v1
     dag_name: bqetl_marketing_suppression_list
-  - task_id: marketing_suppression_list_derived__main_suppression_list__v1
-    dag_name: bqetl_marketing_suppression_list
 bigquery: null
 workgroup_access:
 - role: roles/bigquery.dataViewer
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_suppression_list_external/send_suppression_list_update_to_campaign_monitor_v1/query.py /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_suppression_list_external/send_suppression_list_update_to_campaign_monitor_v1/query.py
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/marketing_suppression_list_external/send_suppression_list_update_to_campaign_monitor_v1/query.py	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/marketing_suppression_list_external/send_suppression_list_update_to_campaign_monitor_v1/query.py	2024-05-16 16:30:08.000000000 +0000
@@ -129,9 +129,6 @@
             destination_project=PROJECT_ID,
             destination_table_id=destination_table_id,
         )
-        click.echo(
-            f"Added {len(not_uploadable_emails)} emails to the list of emails that can't be uploaded due to bad formatting."
-        )
 
 
 if __name__ == "__main__":
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix/geckoview_version/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix/geckoview_version/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix/geckoview_version/schema.yaml	2024-05-16 16:28:33.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/org_mozilla_fenix/geckoview_version/schema.yaml	2024-05-16 16:40:14.000000000 +0000
@@ -1,7 +1,10 @@
 fields:
-- type: DATETIME
-  name: build_hour
-- type: INTEGER
-  name: geckoview_major_version
-- type: INTEGER
-  name: n_pings
+- name: build_hour
+  type: DATETIME
+  mode: NULLABLE
+- name: geckoview_major_version
+  type: INTEGER
+  mode: NULLABLE
+- name: n_pings
+  type: INTEGER
+  mode: NULLABLE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/search_derived/mobile_search_clients_daily_v1/query.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/search_derived/mobile_search_clients_daily_v1/query.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/search_derived/mobile_search_clients_daily_v1/query.sql	2024-05-16 16:28:33.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/search_derived/mobile_search_clients_daily_v1/query.sql	2024-05-16 16:32:32.000000000 +0000
@@ -1,6 +1,4 @@
--- Query generated by ./bqetl generate search
--- This file doesn't get overwritten by the generator. The generator output needs
--- to be written to this file manually.
+-- Query generated by bigquery-etl/search/mobile_search_clients_daily.py
 --
 -- Older versions separate source and engine with an underscore instead of period
 -- Return array of form [source, engine] if key is valid, empty array otherwise
@@ -498,7 +496,7 @@
     metrics.counter.browser_total_uri_count,
     client_info.locale,
   FROM
-    org_mozilla_ios_klar.metrics AS org_mozilla_klar_metrics
+    org_mozilla_ios_klar.metrics AS org_mozilla_ios_klar_metrics
 ),
 fenix_baseline AS (
   SELECT
@@ -874,7 +872,6 @@
     ANY_VALUE(sample_id) AS sample_id,
     udf.map_mode_last(ARRAY_CONCAT_AGG(experiments)) AS experiments,
     SUM(total_uri_count) AS total_uri_count,
-    CAST(NULL AS STRING) AS normalized_engine
   FROM
     combined_search_clients
   WHERE
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/static/ca_postal_districts_v1/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/static/ca_postal_districts_v1/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/static/ca_postal_districts_v1/schema.yaml	2024-05-16 16:28:33.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/static/ca_postal_districts_v1/schema.yaml	2024-05-16 16:40:22.000000000 +0000
@@ -1,9 +1,7 @@
 fields:
 - name: postal_district_code
   type: STRING
-  mode: REQUIRED
-  description: One-character Canadian postal district code.
+  mode: NULLABLE
 - name: province_code
   type: STRING
   mode: NULLABLE
-  description: Two-character Canadian province/territory code (if any).
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/static/country_codes_v1/data.csv /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/static/country_codes_v1/data.csv
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/static/country_codes_v1/data.csv	2024-05-16 16:28:34.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/static/country_codes_v1/data.csv	2024-05-16 16:30:08.000000000 +0000
@@ -1,253 +1,253 @@
-name,code,code_3,region_name,subregion_name,pocket_available_on_newtab,mozilla_vpn_available,sponsored_tiles_available_on_newtab,ads_value_tier
-Afghanistan,AF,AFG,Asia,Southern Asia,FALSE,FALSE,FALSE,null
-Åland Islands,AX,ALA,Europe,Northern Europe,FALSE,FALSE,FALSE,null
-Albania,AL,ALB,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Algeria,DZ,DZA,Africa,Northern Africa,FALSE,FALSE,FALSE,null
-American Samoa,AS,ASM,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-Andorra,AD,AND,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Angola,AO,AGO,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-Anguilla,AI,AIA,North America,Caribbean,FALSE,FALSE,FALSE,null
-Antarctica,AQ,ATA,Antarctica,Antarctica,FALSE,FALSE,FALSE,null
-Antigua and Barbuda,AG,ATG,North America,Caribbean,FALSE,FALSE,FALSE,null
-Argentina,AR,ARG,South America,South America,FALSE,FALSE,FALSE,null
-Armenia,AM,ARM,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Aruba,AW,ABW,North America,Caribbean,FALSE,FALSE,FALSE,null
-Australia,AU,AUS,Oceania,Australia and New Zealand,FALSE,FALSE,TRUE,tier 3
-Austria,AT,AUT,Europe,Western Europe,TRUE,TRUE,FALSE,null
-Azerbaijan,AZ,AZE,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Bahamas,BS,BHS,North America,Caribbean,FALSE,FALSE,FALSE,null
-Bahrain,BH,BHR,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Bangladesh,BD,BGD,Asia,Southern Asia,FALSE,FALSE,FALSE,null
-Barbados,BB,BRB,North America,Caribbean,FALSE,FALSE,FALSE,null
-Belarus,BY,BLR,Europe,Eastern Europe,FALSE,FALSE,FALSE,null
-Belgium,BE,BEL,Europe,Western Europe,TRUE,TRUE,FALSE,null
-Belize,BZ,BLZ,North America,Central America,FALSE,FALSE,FALSE,null
-Benin,BJ,BEN,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Bermuda,BM,BMU,North America,Northern America,FALSE,FALSE,FALSE,null
-Bhutan,BT,BTN,Asia,Southern Asia,FALSE,FALSE,FALSE,null
-"Bolivia, Plurinational State of",BO,BOL,South America,South America,FALSE,FALSE,FALSE,null
-"Bonaire, Sint Eustatius and Saba",BQ,BES,North America,Caribbean,FALSE,FALSE,FALSE,null
-Bosnia and Herzegovina,BA,BIH,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Botswana,BW,BWA,Africa,Southern Africa,FALSE,FALSE,FALSE,null
-Bouvet Island,BV,BVT,South America,South America,FALSE,FALSE,FALSE,null
-Brazil,BR,BRA,South America,South America,FALSE,FALSE,TRUE,tier 3
-British Indian Ocean Territory,IO,IOT,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Brunei Darussalam,BN,BRN,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-Bulgaria,BG,BGR,Europe,Eastern Europe,FALSE,TRUE,FALSE,null
-Burkina Faso,BF,BFA,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Burundi,BI,BDI,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Cambodia,KH,KHM,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-Cameroon,CM,CMR,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-Canada,CA,CAN,North America,Northern America,TRUE,TRUE,TRUE,tier 2
-Cape Verde,CV,CPV,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Cayman Islands,KY,CYM,North America,Caribbean,FALSE,FALSE,FALSE,null
-Central African Republic,CF,CAF,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-Chad,TD,TCD,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-Chile,CL,CHL,South America,South America,FALSE,FALSE,FALSE,null
-China,CN,CHN,Asia,Eastern Asia,FALSE,FALSE,FALSE,null
-Christmas Island,CX,CXR,Oceania,Australia and New Zealand,FALSE,FALSE,FALSE,null
-Cocos (Keeling) Islands,CC,CCK,Oceania,Australia and New Zealand,FALSE,FALSE,FALSE,null
-Colombia,CO,COL,South America,South America,FALSE,FALSE,FALSE,null
-Comoros,KM,COM,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Congo,CG,COG,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-"Congo, the Democratic Republic of the",CD,COD,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-Cook Islands,CK,COK,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-Costa Rica,CR,CRI,North America,Central America,FALSE,FALSE,FALSE,null
-Côte d'Ivoire,CI,CIV,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Croatia,HR,HRV,Europe,Southern Europe,FALSE,TRUE,FALSE,null
-Cuba,CU,CUB,North America,Caribbean,FALSE,FALSE,FALSE,null
-Curaçao,CW,CUW,North America,Caribbean,FALSE,FALSE,FALSE,null
-Cyprus,CY,CYP,Asia,Western Asia,FALSE,TRUE,FALSE,null
-Czech Republic,CZ,CZE,Europe,Eastern Europe,FALSE,TRUE,FALSE,null
-Denmark,DK,DNK,Europe,Northern Europe,FALSE,TRUE,FALSE,null
-Djibouti,DJ,DJI,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Dominica,DM,DMA,North America,Caribbean,FALSE,FALSE,FALSE,null
-Dominican Republic,DO,DOM,North America,Caribbean,FALSE,FALSE,FALSE,null
-Ecuador,EC,ECU,South America,South America,FALSE,FALSE,FALSE,null
-Egypt,EG,EGY,Africa,Northern Africa,FALSE,FALSE,FALSE,null
-El Salvador,SV,SLV,North America,Central America,FALSE,FALSE,FALSE,null
-Equatorial Guinea,GQ,GNQ,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-Eritrea,ER,ERI,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Estonia,EE,EST,Europe,Northern Europe,FALSE,TRUE,FALSE,null
-Ethiopia,ET,ETH,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Falkland Islands (Malvinas),FK,FLK,South America,South America,FALSE,FALSE,FALSE,null
-Faroe Islands,FO,FRO,Europe,Northern Europe,FALSE,FALSE,FALSE,null
-Fiji,FJ,FJI,Oceania,Melanesia,FALSE,FALSE,FALSE,null
-Finland,FI,FIN,Europe,Northern Europe,FALSE,TRUE,FALSE,null
-France,FR,FRA,Europe,Western Europe,TRUE,TRUE,TRUE,tier 2
-French Guiana,GF,GUF,South America,South America,FALSE,FALSE,FALSE,null
-French Polynesia,PF,PYF,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-French Southern Territories,TF,ATF,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Gabon,GA,GAB,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-Gambia,GM,GMB,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Georgia,GE,GEO,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Germany,DE,DEU,Europe,Western Europe,TRUE,TRUE,TRUE,tier 1
-Ghana,GH,GHA,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Gibraltar,GI,GIB,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Greece,GR,GRC,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Greenland,GL,GRL,North America,Northern America,FALSE,FALSE,FALSE,null
-Grenada,GD,GRD,North America,Caribbean,FALSE,FALSE,FALSE,null
-Guadeloupe,GP,GLP,North America,Caribbean,FALSE,FALSE,FALSE,null
-Guam,GU,GUM,Oceania,Micronesia,FALSE,FALSE,FALSE,null
-Guatemala,GT,GTM,North America,Central America,FALSE,FALSE,FALSE,null
-Guernsey,GG,GGY,Europe,Northern Europe,FALSE,FALSE,FALSE,null
-Guinea,GN,GIN,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Guinea-Bissau,GW,GNB,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Guyana,GY,GUY,South America,South America,FALSE,FALSE,FALSE,null
-Haiti,HT,HTI,North America,Caribbean,FALSE,FALSE,FALSE,null
-Heard Island and McDonald Islands,HM,HMD,Oceania,Australia and New Zealand,FALSE,FALSE,FALSE,null
-Holy See (Vatican City State),VA,VAT,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Honduras,HN,HND,North America,Central America,FALSE,FALSE,FALSE,null
-Hong Kong,HK,HKG,Asia,Eastern Asia,FALSE,FALSE,FALSE,null
-Hungary,HU,HUN,Europe,Eastern Europe,FALSE,TRUE,FALSE,null
-Iceland,IS,ISL,Europe,Northern Europe,FALSE,FALSE,FALSE,null
-India,IN,IND,Asia,Southern Asia,TRUE,FALSE,TRUE,tier 3
-Indonesia,ID,IDN,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-"Iran, Islamic Republic of",IR,IRN,Asia,Southern Asia,FALSE,FALSE,FALSE,null
-Iraq,IQ,IRQ,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Ireland,IE,IRL,Europe,Northern Europe,TRUE,TRUE,FALSE,null
-Isle of Man,IM,IMN,Europe,Northern Europe,FALSE,FALSE,FALSE,null
-Israel,IL,ISR,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Italy,IT,ITA,Europe,Southern Europe,TRUE,TRUE,TRUE,tier 2
-Jamaica,JM,JAM,North America,Caribbean,FALSE,FALSE,FALSE,null
-Japan,JP,JPN,Asia,Eastern Asia,FALSE,FALSE,TRUE,tier 3
-Jersey,JE,JEY,Europe,Northern Europe,FALSE,FALSE,FALSE,null
-Jordan,JO,JOR,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Kazakhstan,KZ,KAZ,Asia,Central Asia,FALSE,FALSE,FALSE,null
-Kenya,KE,KEN,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Kiribati,KI,KIR,Oceania,Micronesia,FALSE,FALSE,FALSE,null
-"Korea, Democratic People's Republic of",KP,PRK,Asia,Eastern Asia,FALSE,FALSE,FALSE,null
-"Korea, Republic of",KR,KOR,Asia,Eastern Asia,FALSE,FALSE,FALSE,null
-Kuwait,KW,KWT,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Kyrgyzstan,KG,KGZ,Asia,Central Asia,FALSE,FALSE,FALSE,null
-Lao People's Democratic Republic,LA,LAO,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-Latvia,LV,LVA,Europe,Northern Europe,FALSE,TRUE,FALSE,null
-Lebanon,LB,LBN,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Lesotho,LS,LSO,Africa,Southern Africa,FALSE,FALSE,FALSE,null
-Liberia,LR,LBR,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Libya,LY,LBY,Africa,Northern Africa,FALSE,FALSE,FALSE,null
-Liechtenstein,LI,LIE,Europe,Western Europe,FALSE,FALSE,FALSE,null
-Lithuania,LT,LTU,Europe,Northern Europe,FALSE,TRUE,FALSE,null
-Luxembourg,LU,LUX,Europe,Western Europe,FALSE,TRUE,FALSE,null
-Macao,MO,MAC,Asia,Eastern Asia,FALSE,FALSE,FALSE,null
-"Macedonia, the Former Yugoslav Republic of",MK,MKD,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Madagascar,MG,MDG,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Malawi,MW,MWI,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Malaysia,MY,MYS,Asia,South-eastern Asia,FALSE,TRUE,FALSE,null
-Maldives,MV,MDV,Asia,Southern Asia,FALSE,FALSE,FALSE,null
-Mali,ML,MLI,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Malta,MT,MLT,Europe,Southern Europe,FALSE,TRUE,FALSE,null
-Marshall Islands,MH,MHL,Oceania,Micronesia,FALSE,FALSE,FALSE,null
-Martinique,MQ,MTQ,North America,Caribbean,FALSE,FALSE,FALSE,null
-Mauritania,MR,MRT,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Mauritius,MU,MUS,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Mayotte,YT,MYT,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Mexico,MX,MEX,North America,Central America,FALSE,FALSE,TRUE,tier 3
-"Micronesia, Federated States of",FM,FSM,Oceania,Micronesia,FALSE,FALSE,FALSE,null
-"Moldova, Republic of",MD,MDA,Europe,Eastern Europe,FALSE,FALSE,FALSE,null
-Monaco,MC,MCO,Europe,Western Europe,FALSE,FALSE,FALSE,null
-Mongolia,MN,MNG,Asia,Eastern Asia,FALSE,FALSE,FALSE,null
-Montenegro,ME,MNE,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Montserrat,MS,MSR,North America,Caribbean,FALSE,FALSE,FALSE,null
-Morocco,MA,MAR,Africa,Northern Africa,FALSE,FALSE,FALSE,null
-Mozambique,MZ,MOZ,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Myanmar,MM,MMR,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-Namibia,NA,NAM,Africa,Southern Africa,FALSE,FALSE,FALSE,null
-Nauru,NR,NRU,Oceania,Micronesia,FALSE,FALSE,FALSE,null
-Nepal,NP,NPL,Asia,Southern Asia,FALSE,FALSE,FALSE,null
-Netherlands,NL,NLD,Europe,Western Europe,FALSE,TRUE,FALSE,null
-New Caledonia,NC,NCL,Oceania,Melanesia,FALSE,FALSE,FALSE,null
-New Zealand,NZ,NZL,Oceania,Australia and New Zealand,FALSE,TRUE,FALSE,null
-Nicaragua,NI,NIC,North America,Central America,FALSE,FALSE,FALSE,null
-Niger,NE,NER,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Nigeria,NG,NGA,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Niue,NU,NIU,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-Norfolk Island,NF,NFK,Oceania,Australia and New Zealand,FALSE,FALSE,FALSE,null
-Northern Mariana Islands,MP,MNP,Oceania,Micronesia,FALSE,FALSE,FALSE,null
-Norway,NO,NOR,Europe,Northern Europe,FALSE,FALSE,FALSE,null
-Oman,OM,OMN,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Pakistan,PK,PAK,Asia,Southern Asia,FALSE,FALSE,FALSE,null
-Palau,PW,PLW,Oceania,Micronesia,FALSE,FALSE,FALSE,null
-"Palestine, State of",PS,PSE,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Panama,PA,PAN,North America,Central America,FALSE,FALSE,FALSE,null
-Papua New Guinea,PG,PNG,Oceania,Melanesia,FALSE,FALSE,FALSE,null
-Paraguay,PY,PRY,South America,South America,FALSE,FALSE,FALSE,null
-Peru,PE,PER,South America,South America,FALSE,FALSE,FALSE,null
-Philippines,PH,PHL,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-Pitcairn,PN,PCN,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-Poland,PL,POL,Europe,Eastern Europe,FALSE,TRUE,FALSE,null
-Portugal,PT,PRT,Europe,Southern Europe,FALSE,TRUE,FALSE,null
-Puerto Rico,PR,PRI,North America,Caribbean,FALSE,FALSE,FALSE,null
-Qatar,QA,QAT,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Réunion,RE,REU,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Romania,RO,ROU,Europe,Eastern Europe,FALSE,TRUE,FALSE,null
-Russian Federation,RU,RUS,Europe,Eastern Europe,FALSE,FALSE,FALSE,null
-Rwanda,RW,RWA,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Saint Barthélemy,BL,BLM,North America,Caribbean,FALSE,FALSE,FALSE,null
-"Saint Helena, Ascension and Tristan da Cunha",SH,SHN,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Saint Kitts and Nevis,KN,KNA,North America,Caribbean,FALSE,FALSE,FALSE,null
-Saint Lucia,LC,LCA,North America,Caribbean,FALSE,FALSE,FALSE,null
-Saint Martin (French part),MF,MAF,North America,Caribbean,FALSE,FALSE,FALSE,null
-Saint Pierre and Miquelon,PM,SPM,North America,Northern America,FALSE,FALSE,FALSE,null
-Saint Vincent and the Grenadines,VC,VCT,North America,Caribbean,FALSE,FALSE,FALSE,null
-Samoa,WS,WSM,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-San Marino,SM,SMR,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Sao Tome and Principe,ST,STP,Africa,Middle Africa,FALSE,FALSE,FALSE,null
-Saudi Arabia,SA,SAU,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Senegal,SN,SEN,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Serbia,RS,SRB,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Seychelles,SC,SYC,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Sierra Leone,SL,SLE,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Singapore,SG,SGP,Asia,South-eastern Asia,FALSE,TRUE,FALSE,null
-Sint Maarten (Dutch part),SX,SXM,North America,Caribbean,FALSE,FALSE,FALSE,null
-Slovakia,SK,SVK,Europe,Eastern Europe,FALSE,TRUE,FALSE,null
-Slovenia,SI,SVN,Europe,Southern Europe,FALSE,TRUE,FALSE,null
-Solomon Islands,SB,SLB,Oceania,Melanesia,FALSE,FALSE,FALSE,null
-Somalia,SO,SOM,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-South Africa,ZA,ZAF,Africa,Southern Africa,FALSE,FALSE,FALSE,null
-South Georgia and the South Sandwich Islands,GS,SGS,South America,South America,FALSE,FALSE,FALSE,null
-South Sudan,SS,SSD,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Spain,ES,ESP,Europe,Southern Europe,TRUE,TRUE,TRUE,tier 2
-Sri Lanka,LK,LKA,Asia,Southern Asia,FALSE,FALSE,FALSE,null
-Sudan,SD,SDN,Africa,Northern Africa,FALSE,FALSE,FALSE,null
-Suriname,SR,SUR,South America,South America,FALSE,FALSE,FALSE,null
-Svalbard and Jan Mayen,SJ,SJM,Europe,Northern Europe,FALSE,FALSE,FALSE,null
-Swaziland,SZ,SWZ,Africa,Southern Africa,FALSE,FALSE,FALSE,null
-Sweden,SE,SWE,Europe,Northern Europe,FALSE,TRUE,FALSE,null
-Switzerland,CH,CHE,Europe,Western Europe,TRUE,TRUE,FALSE,null
-Syrian Arab Republic,SY,SYR,Asia,Western Asia,FALSE,FALSE,FALSE,null
-"Taiwan, Province of China",TW,TWN,Asia,Eastern Asia,FALSE,FALSE,FALSE,null
-Tajikistan,TJ,TJK,Asia,Central Asia,FALSE,FALSE,FALSE,null
-"Tanzania, United Republic of",TZ,TZA,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Thailand,TH,THA,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-Timor-Leste,TL,TLS,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-Togo,TG,TGO,Africa,Western Africa,FALSE,FALSE,FALSE,null
-Tokelau,TK,TKL,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-Tonga,TO,TON,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-Trinidad and Tobago,TT,TTO,North America,Caribbean,FALSE,FALSE,FALSE,null
-Tunisia,TN,TUN,Africa,Northern Africa,FALSE,FALSE,FALSE,null
-Turkey,TR,TUR,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Turkmenistan,TM,TKM,Asia,Central Asia,FALSE,FALSE,FALSE,null
-Turks and Caicos Islands,TC,TCA,North America,Caribbean,FALSE,FALSE,FALSE,null
-Tuvalu,TV,TUV,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-Uganda,UG,UGA,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Ukraine,UA,UKR,Europe,Eastern Europe,FALSE,FALSE,FALSE,null
-United Arab Emirates,AE,ARE,Asia,Western Asia,FALSE,FALSE,FALSE,null
-United Kingdom,GB,GBR,Europe,Northern Europe,TRUE,TRUE,TRUE,tier 2
-United States,US,USA,North America,Northern America,TRUE,TRUE,TRUE,tier 1
-United States Minor Outlying Islands,UM,UMI,Oceania,Micronesia,FALSE,FALSE,FALSE,null
-Uruguay,UY,URY,South America,South America,FALSE,FALSE,FALSE,null
-Uzbekistan,UZ,UZB,Asia,Central Asia,FALSE,FALSE,FALSE,null
-Vanuatu,VU,VUT,Oceania,Melanesia,FALSE,FALSE,FALSE,null
-"Venezuela, Bolivarian Republic of",VE,VEN,South America,South America,FALSE,FALSE,FALSE,null
-Viet Nam,VN,VNM,Asia,South-eastern Asia,FALSE,FALSE,FALSE,null
-"Virgin Islands, British",VG,VGB,North America,Caribbean,FALSE,FALSE,FALSE,null
-"Virgin Islands, U.S.",VI,VIR,North America,Caribbean,FALSE,FALSE,FALSE,null
-Wallis and Futuna,WF,WLF,Oceania,Polynesia,FALSE,FALSE,FALSE,null
-Western Sahara,EH,ESH,Africa,Northern Africa,FALSE,FALSE,FALSE,null
-Yemen,YE,YEM,Asia,Western Asia,FALSE,FALSE,FALSE,null
-Zambia,ZM,ZMB,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Zimbabwe,ZW,ZWE,Africa,Eastern Africa,FALSE,FALSE,FALSE,null
-Kosovo,XK,XKK,Europe,Southern Europe,FALSE,FALSE,FALSE,null
-Rest of World,ROW,ROW,Rest of World,Rest of World,FALSE,FALSE,FALSE,null
-Unknown,??,???,Unknown,Unknown,FALSE,FALSE,FALSE,null
+name,code,code_3,region_name,subregion_name,intermediate_region_name,pocket_available_on_newtab,mozilla_vpn_available,sponsored_tiles_available_on_newtab,ads_value_tier
+Afghanistan,AF,AFG,Asia,Southern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Åland Islands,AX,ALA,Europe,Northern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Albania,AL,ALB,Europe,Southern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Algeria,DZ,DZA,Africa,Northern Africa,Unspecified,FALSE,FALSE,FALSE,null
+American Samoa,AS,ASM,Oceania,Polynesia,Unspecified,FALSE,FALSE,FALSE,null
+Andorra,AD,AND,Europe,Southern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Angola,AO,AGO,Africa,Sub-Saharan Africa,Middle Africa,FALSE,FALSE,FALSE,null
+Anguilla,AI,AIA,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Antarctica,AQ,ATA,Unspecified,Unspecified,Unspecified,FALSE,FALSE,FALSE,null
+Antigua and Barbuda,AG,ATG,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Argentina,AR,ARG,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+Armenia,AM,ARM,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Aruba,AW,ABW,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Australia,AU,AUS,Oceania,Australia and New Zealand,Unspecified,FALSE,FALSE,TRUE,tier 3
+Austria,AT,AUT,Europe,Western Europe,Unspecified,TRUE,TRUE,FALSE,null
+Azerbaijan,AZ,AZE,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Bahamas,BS,BHS,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Bahrain,BH,BHR,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Bangladesh,BD,BGD,Asia,Southern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Barbados,BB,BRB,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Belarus,BY,BLR,Europe,Eastern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Belgium,BE,BEL,Europe,Western Europe,Unspecified,TRUE,TRUE,FALSE,null
+Belize,BZ,BLZ,Americas,Latin America and the Caribbean,Central America,FALSE,FALSE,FALSE,null
+Benin,BJ,BEN,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Bermuda,BM,BMU,Americas,Northern America,Unspecified,FALSE,FALSE,FALSE,null
+Bhutan,BT,BTN,Asia,Southern Asia,Unspecified,FALSE,FALSE,FALSE,null
+"Bolivia, Plurinational State of",BO,BOL,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+"Bonaire, Sint Eustatius and Saba",BQ,BES,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Bosnia and Herzegovina,BA,BIH,Europe,Southern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Botswana,BW,BWA,Africa,Sub-Saharan Africa,Southern Africa,FALSE,FALSE,FALSE,null
+Bouvet Island,BV,BVT,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+Brazil,BR,BRA,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,TRUE,tier 3
+British Indian Ocean Territory,IO,IOT,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Brunei Darussalam,BN,BRN,Asia,South-eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Bulgaria,BG,BGR,Europe,Eastern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Burkina Faso,BF,BFA,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Burundi,BI,BDI,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Cambodia,KH,KHM,Asia,South-eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Cameroon,CM,CMR,Africa,Sub-Saharan Africa,Middle Africa,FALSE,FALSE,FALSE,null
+Canada,CA,CAN,Americas,Northern America,Unspecified,TRUE,TRUE,TRUE,tier 2
+Cape Verde,CV,CPV,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Cayman Islands,KY,CYM,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Central African Republic,CF,CAF,Africa,Sub-Saharan Africa,Middle Africa,FALSE,FALSE,FALSE,null
+Chad,TD,TCD,Africa,Sub-Saharan Africa,Middle Africa,FALSE,FALSE,FALSE,null
+Chile,CL,CHL,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+China,CN,CHN,Asia,Eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Christmas Island,CX,CXR,Oceania,Australia and New Zealand,Unspecified,FALSE,FALSE,FALSE,null
+Cocos (Keeling) Islands,CC,CCK,Oceania,Australia and New Zealand,Unspecified,FALSE,FALSE,FALSE,null
+Colombia,CO,COL,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+Comoros,KM,COM,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Congo,CG,COG,Africa,Sub-Saharan Africa,Middle Africa,FALSE,FALSE,FALSE,null
+"Congo, the Democratic Republic of the",CD,COD,Africa,Sub-Saharan Africa,Middle Africa,FALSE,FALSE,FALSE,null
+Cook Islands,CK,COK,Oceania,Polynesia,Unspecified,FALSE,FALSE,FALSE,null
+Costa Rica,CR,CRI,Americas,Latin America and the Caribbean,Central America,FALSE,FALSE,FALSE,null
+Côte d'Ivoire,CI,CIV,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Croatia,HR,HRV,Europe,Southern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Cuba,CU,CUB,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Curaçao,CW,CUW,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Cyprus,CY,CYP,Asia,Western Asia,Unspecified,FALSE,TRUE,FALSE,null
+Czech Republic,CZ,CZE,Europe,Eastern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Denmark,DK,DNK,Europe,Northern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Djibouti,DJ,DJI,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Dominica,DM,DMA,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Dominican Republic,DO,DOM,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Ecuador,EC,ECU,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+Egypt,EG,EGY,Africa,Northern Africa,Unspecified,FALSE,FALSE,FALSE,null
+El Salvador,SV,SLV,Americas,Latin America and the Caribbean,Central America,FALSE,FALSE,FALSE,null
+Equatorial Guinea,GQ,GNQ,Africa,Sub-Saharan Africa,Middle Africa,FALSE,FALSE,FALSE,null
+Eritrea,ER,ERI,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Estonia,EE,EST,Europe,Northern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Ethiopia,ET,ETH,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Falkland Islands (Malvinas),FK,FLK,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+Faroe Islands,FO,FRO,Europe,Northern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Fiji,FJ,FJI,Oceania,Melanesia,Unspecified,FALSE,FALSE,FALSE,null
+Finland,FI,FIN,Europe,Northern Europe,Unspecified,FALSE,TRUE,FALSE,null
+France,FR,FRA,Europe,Western Europe,Unspecified,TRUE,TRUE,TRUE,tier 2
+French Guiana,GF,GUF,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+French Polynesia,PF,PYF,Oceania,Polynesia,Unspecified,FALSE,FALSE,FALSE,null
+French Southern Territories,TF,ATF,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Gabon,GA,GAB,Africa,Sub-Saharan Africa,Middle Africa,FALSE,FALSE,FALSE,null
+Gambia,GM,GMB,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Georgia,GE,GEO,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Germany,DE,DEU,Europe,Western Europe,Unspecified,TRUE,TRUE,TRUE,tier 1
+Ghana,GH,GHA,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Gibraltar,GI,GIB,Europe,Southern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Greece,GR,GRC,Europe,Southern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Greenland,GL,GRL,Americas,Northern America,Unspecified,FALSE,FALSE,FALSE,null
+Grenada,GD,GRD,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Guadeloupe,GP,GLP,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Guam,GU,GUM,Oceania,Micronesia,Unspecified,FALSE,FALSE,FALSE,null
+Guatemala,GT,GTM,Americas,Latin America and the Caribbean,Central America,FALSE,FALSE,FALSE,null
+Guernsey,GG,GGY,Europe,Northern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Guinea,GN,GIN,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Guinea-Bissau,GW,GNB,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Guyana,GY,GUY,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+Haiti,HT,HTI,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Heard Island and McDonald Islands,HM,HMD,Oceania,Australia and New Zealand,Unspecified,FALSE,FALSE,FALSE,null
+Holy See (Vatican City State),VA,VAT,Europe,Southern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Honduras,HN,HND,Americas,Latin America and the Caribbean,Central America,FALSE,FALSE,FALSE,null
+Hong Kong,HK,HKG,Asia,Eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Hungary,HU,HUN,Europe,Eastern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Iceland,IS,ISL,Europe,Northern Europe,Unspecified,FALSE,FALSE,FALSE,null
+India,IN,IND,Asia,Southern Asia,Unspecified,TRUE,FALSE,TRUE,tier 3
+Indonesia,ID,IDN,Asia,South-eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+"Iran, Islamic Republic of",IR,IRN,Asia,Southern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Iraq,IQ,IRQ,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Ireland,IE,IRL,Europe,Northern Europe,Unspecified,TRUE,TRUE,FALSE,null
+Isle of Man,IM,IMN,Europe,Northern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Israel,IL,ISR,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Italy,IT,ITA,Europe,Southern Europe,Unspecified,TRUE,TRUE,TRUE,tier 2
+Jamaica,JM,JAM,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Japan,JP,JPN,Asia,Eastern Asia,Unspecified,FALSE,FALSE,TRUE,tier 3
+Jersey,JE,JEY,Europe,Northern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Jordan,JO,JOR,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Kazakhstan,KZ,KAZ,Asia,Central Asia,Unspecified,FALSE,FALSE,FALSE,null
+Kenya,KE,KEN,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Kiribati,KI,KIR,Oceania,Micronesia,Unspecified,FALSE,FALSE,FALSE,null
+"Korea, Democratic People's Republic of",KP,PRK,Asia,Eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+"Korea, Republic of",KR,KOR,Asia,Eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Kuwait,KW,KWT,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Kyrgyzstan,KG,KGZ,Asia,Central Asia,Unspecified,FALSE,FALSE,FALSE,null
+Lao People's Democratic Republic,LA,LAO,Asia,South-eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Latvia,LV,LVA,Europe,Northern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Lebanon,LB,LBN,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Lesotho,LS,LSO,Africa,Sub-Saharan Africa,Southern Africa,FALSE,FALSE,FALSE,null
+Liberia,LR,LBR,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Libya,LY,LBY,Africa,Northern Africa,Unspecified,FALSE,FALSE,FALSE,null
+Liechtenstein,LI,LIE,Europe,Western Europe,Unspecified,FALSE,FALSE,FALSE,null
+Lithuania,LT,LTU,Europe,Northern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Luxembourg,LU,LUX,Europe,Western Europe,Unspecified,FALSE,TRUE,FALSE,null
+Macao,MO,MAC,Asia,Eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+"Macedonia, the Former Yugoslav Republic of",MK,MKD,Europe,Southern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Madagascar,MG,MDG,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Malawi,MW,MWI,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Malaysia,MY,MYS,Asia,South-eastern Asia,Unspecified,FALSE,TRUE,FALSE,null
+Maldives,MV,MDV,Asia,Southern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Mali,ML,MLI,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Malta,MT,MLT,Europe,Southern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Marshall Islands,MH,MHL,Oceania,Micronesia,Unspecified,FALSE,FALSE,FALSE,null
+Martinique,MQ,MTQ,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Mauritania,MR,MRT,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Mauritius,MU,MUS,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Mayotte,YT,MYT,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Mexico,MX,MEX,Americas,Latin America and the Caribbean,Central America,FALSE,FALSE,TRUE,tier 3
+"Micronesia, Federated States of",FM,FSM,Oceania,Micronesia,Unspecified,FALSE,FALSE,FALSE,null
+"Moldova, Republic of",MD,MDA,Europe,Eastern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Monaco,MC,MCO,Europe,Western Europe,Unspecified,FALSE,FALSE,FALSE,null
+Mongolia,MN,MNG,Asia,Eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Montenegro,ME,MNE,Europe,Southern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Montserrat,MS,MSR,Americas,Latin America and the Caribbean,Caribbean,FALSE,FALSE,FALSE,null
+Morocco,MA,MAR,Africa,Northern Africa,Unspecified,FALSE,FALSE,FALSE,null
+Mozambique,MZ,MOZ,Africa,Sub-Saharan Africa,Eastern Africa,FALSE,FALSE,FALSE,null
+Myanmar,MM,MMR,Asia,South-eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Namibia,NA,NAM,Africa,Sub-Saharan Africa,Southern Africa,FALSE,FALSE,FALSE,null
+Nauru,NR,NRU,Oceania,Micronesia,Unspecified,FALSE,FALSE,FALSE,null
+Nepal,NP,NPL,Asia,Southern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Netherlands,NL,NLD,Europe,Western Europe,Unspecified,FALSE,TRUE,FALSE,null
+New Caledonia,NC,NCL,Oceania,Melanesia,Unspecified,FALSE,FALSE,FALSE,null
+New Zealand,NZ,NZL,Oceania,Australia and New Zealand,Unspecified,FALSE,TRUE,FALSE,null
+Nicaragua,NI,NIC,Americas,Latin America and the Caribbean,Central America,FALSE,FALSE,FALSE,null
+Niger,NE,NER,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Nigeria,NG,NGA,Africa,Sub-Saharan Africa,Western Africa,FALSE,FALSE,FALSE,null
+Niue,NU,NIU,Oceania,Polynesia,Unspecified,FALSE,FALSE,FALSE,null
+Norfolk Island,NF,NFK,Oceania,Australia and New Zealand,Unspecified,FALSE,FALSE,FALSE,null
+Northern Mariana Islands,MP,MNP,Oceania,Micronesia,Unspecified,FALSE,FALSE,FALSE,null
+Norway,NO,NOR,Europe,Northern Europe,Unspecified,FALSE,FALSE,FALSE,null
+Oman,OM,OMN,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Pakistan,PK,PAK,Asia,Southern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Palau,PW,PLW,Oceania,Micronesia,Unspecified,FALSE,FALSE,FALSE,null
+"Palestine, State of",PS,PSE,Asia,Western Asia,Unspecified,FALSE,FALSE,FALSE,null
+Panama,PA,PAN,Americas,Latin America and the Caribbean,Central America,FALSE,FALSE,FALSE,null
+Papua New Guinea,PG,PNG,Oceania,Melanesia,Unspecified,FALSE,FALSE,FALSE,null
+Paraguay,PY,PRY,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+Peru,PE,PER,Americas,Latin America and the Caribbean,South America,FALSE,FALSE,FALSE,null
+Philippines,PH,PHL,Asia,South-eastern Asia,Unspecified,FALSE,FALSE,FALSE,null
+Pitcairn,PN,PCN,Oceania,Polynesia,Unspecified,FALSE,FALSE,FALSE,null
+Poland,PL,POL,Europe,Eastern Europe,Unspecified,FALSE,TRUE,FALSE,null
+Portugal,PT,PRT,Europe,Southern Euro

⚠️ Only part of the diff is displayed.

Link to full diff

curtismorales added 2 commits May 15, 2024 17:27

Backfill last 30 days of event aggregates

90e04dd

Merge branch 'main' into backfill-mobile-suggest

564f67a

fbertsch approved these changes May 16, 2024

View reviewed changes

This comment has been minimized.

Sign in to view

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

AD-310 Backfill last 30 days of event aggregates #5597

AD-310 Backfill last 30 days of event aggregates #5597

curtismorales commented May 16, 2024 •

edited by data-sync-user

This comment has been minimized.

dataops-ci-bot commented May 16, 2024

AD-310 Backfill last 30 days of event aggregates #5597

Are you sure you want to change the base?

AD-310 Backfill last 30 days of event aggregates #5597

Conversation

curtismorales commented May 16, 2024 • edited by data-sync-user

This comment has been minimized.

dataops-ci-bot commented May 16, 2024

Integration report for "Backfill last 30 days of event aggregates"

sql.diff

curtismorales commented May 16, 2024 •

edited by data-sync-user

`sql.diff`