Closed Bug 1335683 Opened 9 years ago Closed 9 years ago

Generate aggregates by upstream ingestion time

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: rvitillo, Assigned: rvitillo)

References

Details

User Story

Ideally we would like to generate aggregates based on the upstream
ingestion time. Unfortunately there aren't strong guarantees that
the data we receive is in order and even if it was one Kafka partition
could lag behind others. One way to address this issue is to use windowed aggregation in event time.

Attachments

(1 file)

PR
53 bytes, text/x-github-pull-request
mdoglio
: review+
Details | Review
No description provided.
Points: --- → 2
Attached file PR —
Attachment #8832382 - Flags: review?(mdoglio)
Attachment #8832382 - Flags: review?(mdoglio) → review+
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.

Attachment

General

Creator:
Created:
Updated:
Size: