# Databricks integration

> Databricks lakehouse REST API — manage clusters, jobs, SQL warehouses, run SQL statements, and govern data with Unity Catalog.

- Authentication: apiKey

## Tools (102)

- **Add DBFS Upload Block**: Append a base64 block to an open DBFS upload stream.
- **Cancel All Job Runs**: Cancel all active runs of a job.
- **Cancel Job Run**: Cancel a run in progress.
- **Cancel SQL Statement**: Cancel a running SQL statement.
- **Close DBFS Upload Stream**: Close an open DBFS upload stream, finalizing the file.
- **Create Catalog**: Create a new catalog in the metastore.
- **Create Cluster**: Create a new cluster; returns a cluster_id, provisioning is asynchronous.
- **Create DBFS Directory**: Create a DBFS directory and parents.
- **Create DBFS Upload Stream**: Open a DBFS write stream for a large file; returns a handle.
- **Create Job**: Create a new job with one or more tasks.
- **Create Pipeline**: Create a Delta Live Tables pipeline.
- **Create Repo**: Clone a Git repository into the workspace.
- **Create Schema**: Create a schema in a catalog.
- **Create Secret Scope**: Create a Databricks-backed secret scope.
- **Create Serving Endpoint**: Create a model serving endpoint.
- **Create SQL Warehouse**: Create a new SQL warehouse.
- **Create Workspace Directory**: Create a workspace directory (and parents) idempotently.
- **Delete Catalog**: Delete a catalog.
- **Delete DBFS File**: Delete a DBFS file or directory.
- **Delete Job**: Delete a job.
- **Delete Job Run**: Delete a non-active run record.
- **Delete Pipeline**: Delete a Delta Live Tables pipeline.
- **Delete Repo**: Delete a Git folder from the workspace.
- **Delete Schema**: Delete a schema.
- **Delete Secret**: Delete a secret from a scope.
- **Delete Secret ACL**: Remove a principal's ACL entry from a secret scope.
- **Delete Secret Scope**: Delete a secret scope and its secrets.
- **Delete Serving Endpoint**: Delete a model serving endpoint.
- **Delete SQL Warehouse**: Delete a SQL warehouse.
- **Delete Table**: Delete a table from the metastore.
- **Delete Workspace Object**: Delete a notebook, file, or folder.
- **Edit Cluster**: Update the configuration of an existing cluster.
- **Execute SQL Statement**: Run a SQL statement on a warehouse; returns a statement_id and (optionally) inline results.
- **Export Job Run**: Export the rendered notebook/HTML output of a run.
- **Export Workspace Object**: Export a notebook or file; content returned base64-encoded.
- **Get Catalog**: Get a single catalog by name.
- **Get Cluster**: Get configuration and current state for one cluster.
- **Get Current User**: Return the identity of the caller (username, display name, id) and validate the token.
- **Get DBFS File Status**: Get size and directory flag for a DBFS path.
- **Get Job**: Get a single job's settings and metadata.
- **Get Job Run**: Get metadata and state for a single run.
- **Get Job Run Output**: Get the output and result of a completed run task.
- **Get Pipeline**: Get a pipeline's spec and latest state.
- **Get Pipeline Update**: Get the status of a pipeline update.
- **Get Repo**: Get one repo's branch/commit metadata.
- **Get Schema**: Get a single schema by full name (catalog.schema).
- **Get Secret ACL**: Get the permission a principal has on a secret scope.
- **Get Serving Endpoint**: Get one serving endpoint's config and state.
- **Get SQL Statement**: Get the status and result of a submitted SQL statement.
- **Get SQL Statement Result Chunk**: Fetch a specific result chunk for a completed statement.
- **Get SQL Warehouse**: Get configuration and state for one SQL warehouse.
- **Get Table**: Get a single table by full name (catalog.schema.table).
- **Get Workspace Object Status**: Get metadata (type, language, object id) for a workspace path.
- **Import Workspace Object**: Import a notebook or file into the workspace from base64 content.
- **List Availability Zones**: List the cloud availability zones available for clusters (AWS).
- **List Catalogs**: List catalogs in the Unity Catalog metastore.
- **List Cluster Events**: Retrieve the event log (activity, resizing, termination) for a cluster.
- **List Clusters**: List all pinned and active clusters plus clusters terminated in the last 30 days.
- **List DBFS Files**: List files and directories at a DBFS path.
- **List Job Runs**: List runs, optionally filtered by job.
- **List Jobs**: List jobs defined in the workspace.
- **List Node Types**: List the instance node types available for clusters in this workspace.
- **List Pipeline Events**: List the event log for a pipeline.
- **List Pipelines**: List Delta Live Tables (Lakeflow) pipelines.
- **List Repos**: List Git repos (Git folders) in the workspace.
- **List Schemas**: List schemas within a catalog.
- **List Secret ACLs**: List access-control entries for a secret scope.
- **List Secrets**: List secret keys and last-updated timestamps in a scope (not values).
- **List Secret Scopes**: List all secret scopes in the workspace.
- **List Serving Endpoints**: List model serving endpoints in the workspace.
- **List Spark Versions**: List the Databricks Runtime versions available for clusters.
- **List SQL Warehouses**: List all SQL warehouses in the workspace.
- **List Tables**: List tables in a schema.
- **List Workspace Objects**: List notebooks, files, and folders under a workspace path.
- **Move DBFS File**: Move or rename a DBFS file/directory.
- **Permanently Delete Cluster**: Permanently delete a cluster; it is removed from the cluster list.
- **Pin Cluster**: Pin a cluster so it is always returned by List Clusters.
- **Put DBFS File**: Upload a small file (≤1 MB) to DBFS in one call.
- **Put Secret**: Create or update a secret in a scope.
- **Put Secret ACL**: Grant a principal a permission on a secret scope.
- **Query Serving Endpoint**: Send an inference request to a model serving endpoint.
- **Read DBFS File**: Read up to 1 MB of a DBFS file; content base64-encoded.
- **Repair Job Run**: Re-run failed or skipped tasks of a run.
- **Reset Job**: Overwrite all settings for a job with a new definition.
- **Resize Cluster**: Change the number of workers on a running cluster.
- **Restart Cluster**: Restart a running cluster.
- **Run Job Now**: Trigger a run of an existing job and return the run_id.
- **Start Cluster**: Start a terminated cluster, preserving its id and configuration.
- **Start Pipeline Update**: Trigger a new update (run) of a pipeline.
- **Start SQL Warehouse**: Start a stopped SQL warehouse.
- **Stop Pipeline**: Stop the active update of a pipeline.
- **Stop SQL Warehouse**: Stop a running SQL warehouse.
- **Submit One-Time Run**: Submit a one-time run without creating a persistent job.
- **Terminate Cluster**: Terminate a cluster; the cluster can be restarted later.
- **Unpin Cluster**: Unpin a previously pinned cluster.
- **Update Catalog**: Update a catalog (rename, owner, comment, properties).
- **Update Job**: Partially update a job's settings (add or change fields).
- **Update Pipeline**: Update (edit) a pipeline's settings.
- **Update Repo**: Check out a branch or tag / pull the latest commit for a repo.
- **Update Schema**: Update a schema (rename, owner, comment, properties).
- **Update Serving Endpoint Config**: Update the served models and traffic config of an endpoint.
- **Update SQL Warehouse**: Update the configuration of a SQL warehouse.

## Related prompts

- [Auto-refresh a Google Sheet from Databricks every night](https://www.generalinput.com/prompts/auto-refresh-a-google-sheet-from-databricks-every-night.md)
- [Daily Databricks data health check with Slack alerts](https://www.generalinput.com/prompts/daily-databricks-data-health-check-with-slack-alerts.md)
- [Weekly Databricks cost digest to catch spend spikes](https://www.generalinput.com/prompts/weekly-databricks-cost-digest-to-catch-spend-spikes.md)
- [Weekly executive KPI brief from your Databricks lakehouse](https://www.generalinput.com/prompts/weekly-executive-kpi-brief-from-your-databricks-lakehouse.md)

Connect Databricks in General Input: https://www.generalinput.com/apps/databricks