Closed Bug 1331880 Opened 9 years ago Closed 9 years ago

Streaming app should access Kafka cluster with 100% of data

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: rvitillo, Assigned: whd)

References

Details

(Whiteboard: [SvcOps])

User Story

We currently have access to a Kafka cluster with 1% of the data. Wesley temporarily bumped it up to 10% yesterday. It would be great if we could keep it to at least 10% for now with an eye to 100% as me move closer to something tangible.
No description provided.
Whiteboard: [SvcOps]
Jason to talk to :whd and update bug accordingly
Flags: needinfo?(jthomas)
:whd will work on getting the kafka cluster to handle 10% of data.
Assignee: nobody → whd
Points: --- → 2
Flags: needinfo?(jthomas)
Priority: -- → P1
Depends on: 1335969
I've built up the dev kafka using m4.xlarges (which we'll have some surplus of after we move to athena), so it should be able to handle 10% now. However, I'm going to wait until I've fixed up prod per bug #1335969 before actually turning it up to 10%.
I've bumped this up to 10%. We plan on as part of the data IAM migration providing access to a kafka cluster with 100% of the decoded data via kafka mirroring from prod in the future. I'll reopen this if the 10% cluster craps out again.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.