Closed Bug 1396832 Opened 8 years ago Closed 8 years ago

Airflow appears to have stopped running main_summary DAG tasks on Sept. 1

Categories

(Data Platform and Tools :: General, enhancement)

Product:
Data Platform and Tools
Component:
General
Type:
enhancement
Priority:
Not set
Severity:
normal

Tracking

(Not tracked)

Status:
RESOLVED FIXED

People

(Reporter: mreid, Unassigned)

Details

The Airflow UI shows the last run date for Main Summary as Sept. 1, and the last five DAG runs show as "running" state, despite all their dependent tasks being finished (other than Heavy Users)
Depends on: 1392310
This wasn't caused by bug #1392310, but I don't have anything more specific than that as for the cause. Presumably setting the currently "running" jobs to succeeded will cause newer DAG runs to occur.
For now I set the "running" jobs to success and manually ran the job for the intervening days. I'll be monitoring that main_summary behaves correctly manually for now, and if this continues to be an issue I'll investigate further and possibly add "not run" type alerting.
No longer depends on: 1392310
This didn't crop up again, so calling it fixed.
Status: NEW → RESOLVED
Closed: 8 years ago
Resolution: --- → FIXED
Component: Scheduling → General
You need to log in before you can comment on or make changes to this bug.