1401969 - Add normalized_os_version to validated pings

Status: RESOLVED FIXED

(Data Platform and Tools :: General, enhancement, P3)

Description

[Frank Bertsch [:frank]]

This can just match the regex in [0].

[0] https://github.com/mozilla/telemetry-streaming/commit/eb6f5278bc3686bc705dbd4938312ecc953ee917

Comment 1

[Mark Reid [:mreid]]

This should be straightforward, since it's a direct function of the field value.

Setting priority to P3 for now since the quarter's just about out.

Comment 2

[Allen Short [:ashort]]

Please review: https://github.com/mozilla-services/lua_sandbox_extensions/pull/177

Will this require adding fields to schemas in mozilla-pipeline-schemas?

Comment 3

[Mark Reid [:mreid]]

Frank, if we add a new field to the "metadata" section in the direct-to-parquet outputs, that will break schema evolution in (some? all?) data sources, right?

Specifically, if we added this normalizedOSVersion field to somewhere like [1].

[1] https://github.com/mozilla-services/mozilla-pipeline-schemas/blob/9da6df743c4d02ffcf4d69cd56988ebb8f0942e0/schemas/telemetry/new-profile/new-profile.4.parquetmr.txt#L7

Comment 4

[Frank Bertsch [:frank]]

Yes, it will break schema evolution. I would prefer we follow the approach suggested in bug 1403608.

Comment 5

[Mark Reid [:mreid]]

Fixed by https://github.com/mozilla-services/lua_sandbox_extensions/pull/177