The bestiary · The 3 a.m. Banshee
Haunting 5 data teams
Specimen · catalogued monster
The 3 a.m. Banshee
Screams whenever the nightly pipeline fails
5Data teams haunted
2 of 21On the leaderboard
It keeps vigil over every overnight load, silent while the jobs run and inconsolable the moment one stumbles. Its wail carries through every floor of the building, and it never, ever, chooses a sociable hour.
Symptoms
- Nightly jobs failing several times a week
- Late or incomplete data every morning
- Upstream schema changes break things silently
- The business notices before the data team
- Engineers rerunning failed jobs by hand
Weakness
Data observability and DataOps: tests in every pipeline, freshness and volume monitoring, contracts with upstream teams and clear runbooks, so the alarm sounds before the boardroom does.
Overheard in the corridor
- “The overnight load failed again.”
- “Why is yesterday's data missing?”
- “We find out from the CEO, not from monitoring.”
- “Half my team's week goes on reruns.”
Share this monster
Spotted in a Halloween data bestiary: The 3 a.m. Banshee. I know at least one team it's haunting. Which monster is lurking in yours? Confess and find out below. #WhatHauntsYourData #DataMonsters https://data-monsters.fun/m/three-am-banshee