Closed Bug 1337816 Opened 9 years ago Closed 9 years ago

KafkaSource fails to initialize partition offsets

Categories

(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)

Product:
Cloud Services Graveyard
Component:
Metrics: Pipeline
Type:
defect

Tracking

(Not tracked)

Status:
RESOLVED INVALID

People

(Reporter: rvitillo, Assigned: rvitillo)

References

Details

User Story

A Kafka source with many partitions can cause the check-pointing logic to fail on restart. I have submitted a fix for it upstream [1] and I have also uploaded a JAR with the fix to a public location [2]. The JAR can be used by a SBT project by copying it under the ./lib directory.

[1] https://issues.apache.org/jira/browse/SPARK-19517
[2] https://people-mozilla.org/~rvitillo/spark-sql-kafka-0-10_2.11-2.2.0-SNAPSHOT.jar
No description provided.
Points: --- → 1
Priority: -- → P1
User Story: (updated)
We are moving project tracking to https://github.com/orgs/mozilla/projects/2.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → INVALID
Product: Cloud Services → Cloud Services Graveyard
You need to log in before you can comment on or make changes to this bug.