1172996 - Discard "main" pings in the old telemetry backend

Status: RESOLVED FIXED

(Webtools Graveyard :: Telemetry Server, defect)

Description

[Mark Reid [:mreid]]

As I understand it, the Telemetry v2 backend only uses "saved-session" pings.  Since the plan is to deprecate that backend in favour of the Unified Telemetry / Data Pipeline project, we should filter out "main" pings to minimize redundant storage.

Comment 1

[Mark Reid [:mreid]]

Vladan, Roberto, does that seem reasonable to you?

Comment 2

[Roberto Agostino Vitillo (:rvitillo)]

I am OK with it.

Comment 3

[Vladan Djeric (:vladan)]

Personally, I don't have any use for "main" pings in the old backend.
The only use I can imagine (for anyone) is either as a backup (if we think new pipeline is lossy) or for comparison of v4 data in the new and old pipelines.

Comment 4

[Mark Reid [:mreid]]

I don't think the new pipeline is lossy, and I think for any comparison between pipelines we can used saved-session data.

Comment 5

[Mark Reid [:mreid]]

Rather than collecting, parsing, and discarding pings in the old pipeline, we will filter out "main" pings before they reach the old pipeline at all.

See:
https://github.com/mozilla-services/puppet-config/pull/1427

Comment 6

[Mark Reid [:mreid]]

This has been deployed, and appears to be working as expected.