Closed
Bug 1307092
Opened 9 years ago
Closed 9 years ago
Update orphaning job failed
Categories
(Cloud Services Graveyard :: Metrics: Pipeline, defect, P1)
Cloud Services Graveyard
Metrics: Pipeline
Tracking
(Not tracked)
RESOLVED
FIXED
People
(Reporter: rvitillo, Assigned: frank)
References
Details
User Story
The update orphaning job failed but I can't see why it failed from the logs. Mauro, this might be due to the recent changes we landed (maybe whitespace in filenames not handled correctly?), could you please have a look? We should make sure that exceptions or errors are shown on stderr or stdout.
--------------------------------------------------------------------------------
Starting attempt 1 of 3
--------------------------------------------------------------------------------
[2016-10-02 04:40:14,663] {models.py:1219} INFO - Executing <Task(EMRSparkOperator): update_orphaning> on 2016-09-25 00:00:00
[2016-10-02 04:40:14,683] {connectionpool.py:203} INFO - Starting new HTTP connection (1): 169.254.169.254
[2016-10-02 04:40:14,685] {connectionpool.py:203} INFO - Starting new HTTP connection (1): 169.254.169.254
[2016-10-02 04:40:14,686] {credentials.py:481} INFO - Found credentials from IAM Role: telemetry-ecs-cloudformation-TelemetryECSRole-1UAYK6XNB6DG0
[2016-10-02 04:40:14,705] {connectionpool.py:758} INFO - Starting new HTTPS connection (1): s3-us-west-2.amazonaws.com
[2016-10-02 04:40:14,729] {connectionpool.py:735} INFO - Starting new HTTPS connection (1): us-west-2.elasticmapreduce.amazonaws.com
[2016-10-02 04:40:15,047] {emr_spark_operator.py:135} INFO - Running Spark Job Update Orphaning View with JobFlow ID j-2G53VOE2FL2NM
[2016-10-02 04:40:15,047] {emr_spark_operator.py:140} INFO - Logs will be available at: https://console.aws.amazon.com/s3/home?region=us-west-2#&bucket=telemetry-airflow&prefix=logs/spohl@mozilla.com/Update Orphaning View/j-2G53VOE2FL2NM
[2016-10-02 04:40:15,096] {emr_spark_operator.py:160} INFO - Spark Job 'Update Orphaning View' status' is STARTING
[2016-10-02 04:45:15,198] {connectionpool.py:238} INFO - Resetting dropped connection: us-west-2.elasticmapreduce.amazonaws.com
[2016-10-02 04:45:15,323] {emr_spark_operator.py:160} INFO - Spark Job 'Update Orphaning View' status' is BOOTSTRAPPING
[2016-10-02 04:50:15,335] {connectionpool.py:238} INFO - Resetting dropped connection: us-west-2.elasticmapreduce.amazonaws.com
[2016-10-02 04:50:15,435] {emr_spark_operator.py:160} INFO - Spark Job 'Update Orphaning View' status' is BOOTSTRAPPING
[2016-10-02 04:55:15,527] {connectionpool.py:238} INFO - Resetting dropped connection: us-west-2.elasticmapreduce.amazonaws.com
[2016-10-02 04:55:15,589] {models.py:1286} ERROR - Spark job Update Orphaning View terminated with errors: STEP_FAILURE - Shut down as step failed
Attachments
(1 file)
No description provided.
|
Reporter | |
Updated•9 years ago
|
User Story: (updated)
|
|
Reporter | |
Updated•9 years ago
|
Flags: needinfo?(mdoglio)
|
|
Reporter | |
Updated•9 years ago
|
User Story: (updated)
|
Assignee | |
Updated•9 years ago
|
Assignee: nobody → fbertsch
|
|
Reporter | |
Updated•9 years ago
|
Points: --- → 1
Priority: -- → P1
|
||
Comment 1•9 years ago
|
||
|
||
Updated•9 years ago
|
Flags: needinfo?(mdoglio)
|
|
Assignee | |
Comment 2•9 years ago
|
||
Orphaning job successfully ran.
Status: NEW → RESOLVED
Closed: 9 years ago
Resolution: --- → FIXED
|
||
Updated•7 years ago
|
Product: Cloud Services → Cloud Services Graveyard
You need to log in
before you can comment on or make changes to this bug.
Description
•