Skip to content

Conversation

@jrmuizel
Copy link
Contributor

@jrmuizel jrmuizel commented Jun 30, 2020

These correspond to telemetry added in
https://bugzilla.mozilla.org/show_bug.cgi?id=1649215
and https://bugzilla.mozilla.org/show_bug.cgi?id=1648304

Checklist for reviewer:

  • Commits should reference a bug or github issue, if relevant (if a bug is referenced, the pull request should include the bug number in the title)
  • Scan the PR and verify that no changes (particularly to .circleci/config.yml) will cause environment variables (particularly credentials) to be exposed in test logs
  • If the PR comes from a fork, trigger the integration CI test by pushing this revision as discussed in the README and review the report posted in the comments.

For glean changes:

  • Update include/glean/CHANGELOG.md

@auto-assign auto-assign bot requested a review from sunahsuh June 30, 2020 18:57
@jklukas jklukas requested review from acmiyaguchi and jklukas and removed request for sunahsuh June 30, 2020 19:07
@jklukas
Copy link
Contributor

jklukas commented Jun 30, 2020

This looks good to me. I'm tagging @acmiyaguchi for additional review since this touches all pings with environment. Do you concur that the test results here indicate no regressions in validation for existing pings?

@acmiyaguchi
Copy link
Contributor

Yes, although the corresponding field should be added to one of the validation pings to ensure it's being captured in a unit test.

Copy link
Contributor

@acmiyaguchi acmiyaguchi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you add a validation document with some expected values, using https://github.com/mozilla-services/mozilla-pipeline-schemas/blob/master/validation/telemetry/main.4.min.pass.json as a base?

@jrmuizel
Copy link
Contributor Author

Can you add a validation document with some expected values, using https://github.com/mozilla-services/mozilla-pipeline-schemas/blob/master/validation/telemetry/main.4.min.pass.json as a base?

Done.

@acmiyaguchi acmiyaguchi merged commit 97bac7a into mozilla-services:master Jun 30, 2020
@jrmuizel
Copy link
Contributor Author

Thanks. When can I expect the schema change to be applied?

@acmiyaguchi
Copy link
Contributor

It should be applied about 1-2 hours after midnight UTC. You'll see the fields in the "live" tables (e.g. moz-fx-data-shared-prod.telemetry_live.main_v4) as soon as it's deployed. This table is updated on a ~10 minute frequency, with a short retention period. There is a day lag before you can see it in the "stable" table (e.g. moz-fx-data-shared-prod.telemetry.main) since those only contain full days of data.

https://docs.telemetry.mozilla.org/cookbooks/bigquery/querying.html#table-layout-and-naming

dataops-pipeline-schemas added a commit that referenced this pull request Jul 1, 2020
97bac7a	2020-06-30 15:16:36 -0700	Add 'openglCompositing' and 'wrCompositor' to schema (#569)
acmiyaguchi pushed a commit that referenced this pull request Jul 22, 2020
361c16d	2020-07-22 20:48:09 +0000	Add xfocsp-error-report schema (#581)
8b05ee6	2020-07-21 14:27:14 -0700	Add regrets-reporter schemas (#556)
e724d79	2020-07-17 11:02:54 -0400	Bug 1652842 - Add a blocklist field so the environment schema works with pre- and post-bug-1647225 data (#576)
7400dc8	2020-07-15 12:46:09 +0200	Bug 1652834 - Add gfx.EmbeddedInFirefoxReality field to environment.
490cfe0	2020-07-14 16:39:13 -0400	AET update: 64-char user_ids and relaxing validation
8f22589	2020-07-14 11:56:08 -0400	Specify yaml loader in extract_crash_annotation_fields script (#573)
f0f50c4	2020-07-14 11:55:40 -0400	Bug 1652777 - Add experimental features to crash ping schema (#574)
97bac7a	2020-06-30 15:16:36 -0700	Add 'openglCompositing' and 'wrCompositor' to schema (#569)
c47313b	2020-06-29 18:40:32 +0000	Remove ecosystem_device_id fields (#567)
2cfd30a	2020-06-26 15:09:52 -0400	Make ecosystem_device_id an optional field
3f11d8b	2020-06-23 18:03:10 +0200	Update sync ping schema to make all migration fields transpiled into BQ
e678002	2020-06-22 14:12:25 -0400	add history_average_days_per_month to schema
be61e13	2020-06-22 14:12:25 -0400	fix schema to contain all fields
6ecd201	2020-06-22 14:12:25 -0400	add schema for normandy-login-study bug 1643383
2e62aac	2020-06-22 12:53:32 -0400	Pin Centos image
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants