Daily Fivetran pipeline status log in Google Sheets
Automatically log the status of every Fivetran data pipeline to a Google Sheet each morning, so you can chart uptime and spot pipelines that fail repeatedly.
Every day at 7am, log the current status of every Fivetran connection to a Google Sheet so I build a running history of my data pipelines. This is a straight deterministic export: one row per connection per day, with no summarizing or reasoning.
First, call Fivetran's List Connections operation to retrieve every connection in the account. For each connection, read its name, source type (the connection's service), group_id, sync state (status.sync_state), last successful sync time, and paused flag.
Map each connection into one flat row with these columns: date, connection name, source type, group, destination, sync state, last successful sync, and paused. Use today's date for the date column. In Fivetran each connection belongs to a group that corresponds to a destination, so use the group_id for both the group and destination columns.
Append the rows to a tracking tab in my Google Sheet using Google Sheets' Append Values operation. On the first run, if the tab is empty, write the header row first. Always append below the last row and never overwrite existing history, so each day's snapshot stacks on top of the previous days.
The result is a growing daily log I can chart to track pipeline uptime and spot connections that fail repeatedly over time.
Additional information
What does this prompt do?
- Every morning, records the current status of all your Fivetran data pipelines into a Google Sheet.
- Adds one row per pipeline per day: pipeline name, source, group, destination, sync state, last successful sync, and whether it is paused, all stamped with the date.
- Builds a running history you can chart to track uptime and catch pipelines that break again and again.
- Appends to your tracking tab without overwriting, so no history is ever lost.
What do I need to use this?
- A Fivetran account with data pipelines already set up.
- A Google account with a Google Sheet and a tab set aside to store the history.
How can I customize it?
- Change the time it runs each day (7am by default) or how often it runs.
- Point it at a different spreadsheet or tracking tab.
- Adjust which pipeline details you record in each row.
Frequently asked questions
Does this change anything in Fivetran?
Will it overwrite my existing data?
What if I have a lot of pipelines?
Can I chart pipeline uptime from this?
What time does it run?
Related templates
Stop guessing whether your data pipelines are healthy.
Set up a daily log of every Fivetran pipeline in Google Sheets and let your uptime history build itself.