Fix broken Fivetran pipelines from one triage board
Open one board every morning to see which data pipelines are broken, test and retry them in place, and spot the ones that keep failing.
Build me an app my data team opens every morning to actually triage broken Fivetran pipelines, not just get told about them. This is a control surface, a workbench where I test, retry, pause, and ticket. It is not a digest and not a monitor, so nothing should run on a schedule or push a notification on its own. Everything happens because someone opened the app and clicked.
The main view is a board of every connection, pulled with Fivetran List Connections, grouped into four columns by health: broken, stale, paused, and healthy. Every row shows the connection name and its source service, the last sync time, the sync frequency, the destination it loads into, and the failure reason when there is one. Resolve destinations by calling Fivetran List Destinations once per load and joining connections to destinations by group so I can see the warehouse each pipeline feeds without a lookup per row. Pull the per connection detail with Fivetran Get Connection and Fivetran Get Connection State to get the real status and failure reason rather than a generic error.
Use these grouping rules. Broken means the connection reports a failed sync or a failed setup state, or its setup tests are failing. Paused means the connection is paused, and keep these separate from broken so an intentionally paused pipeline never reads as an incident. Stale means the last successful sync is older than two of the connection's own sync intervals, falling back to a 24 hour threshold when the frequency is unknown. Healthy is everything else. Sort broken first and show a count on each group so the board leads with what needs attention.
From any row I can act without leaving the app. Run Connection Setup Tests confirms whether credentials or connectivity are the problem, and I want the individual test results rendered as a readable pass or fail list, not a raw blob. Sync Connection retries an incremental sync and Re-sync Connection kicks off a full historical re-sync, with a confirmation step on the full re-sync since it is expensive. Re-sync Connection Tables covers the narrower case where only specific tables need rebuilding. Modify Connection lets me pause a noisy pipeline or stretch its sync frequency straight from the row. Show the destination warehouse and current schedule near these controls so I know what I am about to change.
Bake in an important Fivetran nuance. The sync, re-sync, and schema reload calls are asynchronous: they queue work and return immediately, so never treat a successful response as a finished sync. After triggering one, poll Get Connection and read the sync state from the connection status to drive a live progress indicator on that row, and stop polling when it settles or when a sensible timeout is reached. Setup tests are different, they run synchronously and return their results directly, so those can be shown as soon as the call returns. Fivetran also rate limits per account, with much tighter limits for sync and setup test calls, so batch the board load, respect the retry delay the API asks for, and degrade gracefully instead of hammering it.
Every broken connection gets a Diagnose button that kicks off a background agent for that connection. The agent pulls Get Connection, Get Connection State, and Get Connection Schema Config, runs Run Connection Setup Tests, and works out what is actually wrong: expired or rotated credentials, a source schema change, a permissions problem at the destination, or a transient failure that will clear on a retry. It then writes a plain English root cause note back into the app beside that connection, including what it checked and what it recommends I do next. When the failure looks real rather than transient, it files a Linear issue with Create Issue, putting the connection name, the destination, the failure reason, and its recommendation in the description, and posts a Slack heads up with Send a Message linking the connection and the new issue. When the failure looks transient it says so in the note and does not file anything, so we are not opening tickets for blips. Show the diagnosis state on the row while the agent is working and surface the note, the issue link, and the timestamp when it finishes.
Keep a visible history of which connections break repeatedly so chronic offenders stand out instead of the team re-triaging the same pipeline every week. Record a health snapshot for every connection each time the board loads, and store the diagnosis notes and any filed issue links against the connection permanently. Each row shows how many times that pipeline has broken in the last 30 and 90 days, and anything crossing a repeat offender threshold gets a clear badge. Give me a history view per connection with its past failures, past root cause notes, and linked tickets, so I can see at a glance that a pipeline has failed for the same reason six times and needs a real fix rather than another re-sync.
The audience is data engineers and analytics engineers who own the ELT stack, so density beats decoration. Make the board scannable at a glance, keep the failure reason readable without expanding a row, and make the destructive actions, full re-sync and pause, deliberate rather than easy to fire by accident.
What does this prompt do?
- Groups every Fivetran connection into broken, stale, paused, and healthy, so you can see where to start. Each row shows the last sync time, how often it runs, the destination warehouse it loads into, and the actual failure reason.
- Lets you act without leaving the board: check whether credentials are the problem, retry a sync, kick off a full re-sync, or pause a noisy pipeline and stretch its schedule.
- Gives every broken pipeline a Diagnose button that sends a background agent to investigate and write a plain-English root cause note next to that connection.
- Files a Linear ticket and posts a Slack heads-up when a failure turns out to be real, and keeps a running break history so pipelines that fail week after week stand out.
What do I need to use this?
- A Fivetran account you can create an API key in, so the board can read your pipelines and act on them
- A Linear workspace, plus the team where pipeline tickets should land
- A Slack workspace and the channel your data team actually watches
- Permission to pause and re-sync pipelines, since the board can make real changes
How can I customize it?
- Change what counts as stale. The default flags any pipeline whose last successful sync is older than two of its own sync intervals.
- Point tickets at a different Linear team or send the heads-up to a different Slack channel, and decide how serious a failure has to be before either one fires.
- Adjust the columns on each row or the order of the health groups, so the warehouse, schema, or owner you care about shows up first.
FAQs
How is this different from getting a Slack alert when a pipeline breaks?
Will it change my pipelines on its own?
How does it know which pipelines break repeatedly?
Do I have to be an engineer to use it?
Will it work on a Fivetran trial account?
Related templates
Search creators for free, shortlist the best with your team, and spend an audit credit only when you decide someone is worth a closer look.
One screen showing invited, completed, and shortlisted counts for every open role, plus the stalled invites that have quietly gone nowhere.
Open one board each morning, see which voice calls went badly, replay the exact moment the caller got frustrated, and file the fix.
See every customer waiting on a bug fix, file the ticket without creating a duplicate, and tell them the moment engineering ships it.
Open one board each morning to see which of your facilities, suppliers and shipping lanes are sitting near trouble in the news right now.
Pick creators from your saved list and see their best and worst Instagram posts side by side, so your brief is built on what actually lands.
Stop re-triaging the same broken pipeline every week.
Open one board that shows what is broken, lets you fix it in place, and remembers which pipelines keep failing.