# Braintrust integration > AI evals and observability: projects, experiments, datasets, logs, prompts, functions, scorers and access control, plus SQL queries over traces. - Authentication: apiKey ## Tools (164) - **Batch update acls**: Batch update acls. Batch update acls. This operation is idempotent, so adding acls which already exist will have no effect, and removing acls which do not exist will have no effect. - **Check API reachability**: Hello world endpoint. Default endpoint. Simply replies with 'Hello, World!'. - **Create acl**: Create acl. Create a new acl. If there is an existing acl with the same contents as the one specified in the request, will return the existing acl unmodified - **Create agent**: Create agent. Create a new agent. If there is an existing agent with the same name as the one specified in the request, will return the existing agent unmodified - **Create ai secret**: Create ai secret. Create a new ai_secret. If there is an existing ai_secret with the same name as the one specified in the request, will return the existing ai_secret unmodified - **Create dataset**: Create dataset. Create a new dataset. If there is an existing dataset in the project with the same name as the one specified in the request, will return the existing dataset unmodified - **Create dataset snapshot**: Create dataset snapshot. Create a new dataset_snapshot. If there is an existing dataset_snapshot with the same name as the one specified in the request, will return the existing dataset_snapshot unmodified - **Create environment**: Create environment. Create a new environment - **Create env var**: Create env var. Create a new env_var. If there is an existing env_var with the same name as the one specified in the request, will return the existing env_var unmodified - **Create experiment**: Create experiment. Create a new experiment. If there is an existing experiment in the project with the same name as the one specified in the request, will return the existing experiment unmodified - **Create function**: Create function. Create a new function. If there is an existing function in the project with the same slug as the one specified in the request, a new version of the function will be appended and returned - **Create group**: Create group. Create a new group. If there is an existing group with the same name as the one specified in the request, will return the existing group unmodified - **Create mcp server**: Create mcp server. Create a new mcp_server. If there is an existing mcp_server with the same name as the one specified in the request, will return the existing mcp_server unmodified - **Create org automation**: Create org automation. Create a new org_automation. If there is an existing org_automation with the same name as the one specified in the request, will return the existing org_automation unmodified - **Create or replace agent**: Create or replace agent. Create or replace agent. If there is an existing agent with the same name as the one specified in the request, will replace the existing agent with the provided fields - **Create or replace ai secret**: Create or replace ai secret. Create or replace ai_secret. If there is an existing ai_secret with the same name as the one specified in the request, will replace the existing ai_secret with the provided fields - **Create or replace dataset snapshot**: Create or replace dataset snapshot. Create or replace dataset_snapshot. If there is an existing dataset_snapshot with the same name as the one specified in the request, will replace the existing dataset_snapshot with the provided fields - **Create or replace env var**: Create or replace env var. Create or replace env_var. If there is an existing env_var with the same name as the one specified in the request, will replace the existing env_var with the provided fields - **Create or replace function**: Create or replace function. Create or replace function. If there is an existing function in the project with the same slug as the one specified in the request, a new version of the function will be appended and returned - **Create or replace group**: Create or replace group. Create or replace group. If there is an existing group with the same name as the one specified in the request, will replace the existing group with the provided fields - **Create or replace mcp server**: Create or replace mcp server. Create or replace mcp_server. If there is an existing mcp_server with the same name as the one specified in the request, will replace the existing mcp_server with the provided fields - **Create or replace org automation**: Create or replace org automation. Create or replace org_automation. If there is an existing org_automation with the same name as the one specified in the request, will replace the existing org_automation with the provided fields - **Create or replace project automation**: Create or replace project automation. Create or replace project_automation. If there is an existing project_automation with the same name as the one specified in the request, will replace the existing project_automation with the provided fields - **Create or replace project group**: Create or replace project group. Create or replace project_group. If there is an existing project_group with the same name as the one specified in the request, will replace the existing project_group with the provided fields - **Create or replace project score**: Create or replace project score. Create or replace project_score. If there is an existing project_score in the project with the same name as the one specified in the request, will replace the existing project_score with the provided fields - **Create or replace project tag**: Create or replace project tag. Create or replace project_tag. If there is an existing project_tag in the project with the same name as the one specified in the request, will replace the existing project_tag with the provided fields - **Create or replace prompt**: Create or replace prompt. Create or replace prompt. If there is an existing prompt in the project with the same slug as the one specified in the request, a new version of the prompt will be appended and returned - **Create or replace role**: Create or replace role. Create or replace role. If there is an existing role with the same name as the one specified in the request, will replace the existing role with the provided fields - **Create or replace service token**: Create or replace service token. Create or replace service_token. If there is an existing service_token with the same name as the one specified in the request, will replace the existing service_token with the provided fields - **Create or replace span iframe**: Create or replace span iframe. Create or replace span_iframe. If there is an existing span_iframe with the same name as the one specified in the request, will replace the existing span_iframe with the provided fields - **Create or replace view**: Create or replace view. Create or replace view. If there is an existing view with the same name as the one specified in the request, will replace the existing view with the provided fields - **Create project**: Create project. Create a new project. If there is an existing project with the same name as the one specified in the request, will return the existing project unmodified - **Create project automation**: Create project automation. Create a new project_automation. If there is an existing project_automation with the same name as the one specified in the request, will return the existing project_automation unmodified - **Create project group**: Create project group. Create a new project_group. If there is an existing project_group with the same name as the one specified in the request, will return the existing project_group unmodified - **Create project score**: Create project score. Create a new project_score. If there is an existing project_score in the project with the same name as the one specified in the request, will return the existing project_score unmodified - **Create project tag**: Create project tag. Create a new project_tag. If there is an existing project_tag in the project with the same name as the one specified in the request, will return the existing project_tag unmodified - **Create prompt**: Create prompt. Create a new prompt. If there is an existing prompt in the project with the same slug as the one specified in the request, a new version of the prompt will be appended and returned - **Create role**: Create role. Create a new role. If there is an existing role with the same name as the one specified in the request, will return the existing role unmodified - **Create service token**: Create service token. Create a new service token. When calling this endpoint, you must authenticate using a service token that has organization-owner permissions. - **Create span iframe**: Create span iframe. Create a new span_iframe. If there is an existing span_iframe with the same name as the one specified in the request, will return the existing span_iframe unmodified - **Create temporary credential**: Create temporary credential. Create a temporary credential which can access the proxy for a limited time. - **Create view**: Create view. Create a new view. If there is an existing view with the same name as the one specified in the request, will return the existing view unmodified - **Cross-object insert**: Cross-object insert. Insert events and feedback across object types - **Delete acl**: Delete acl. Delete an acl object by its id - **Delete agent**: Delete agent. Delete a agent object by its id - **Delete ai secret**: Delete ai secret. Delete an ai_secret object by its id - **Delete api key**: Delete api key. Delete an api_key object by its id - **Delete dataset**: Delete dataset. Delete a dataset object by its id - **Delete dataset snapshot**: Delete dataset snapshot. Delete a dataset_snapshot object by its id - **Delete environment**: Delete environment. - **Delete env var**: Delete env var. Delete an env_var object by its id - **Delete experiment**: Delete experiment. Delete an experiment object by its id - **Delete function**: Delete function. Delete a function object by its id - **Delete group**: Delete group. Delete a group object by its id - **Delete mcp server**: Delete mcp server. Delete a mcp_server object by its id - **Delete org automation**: Delete org automation. Delete a org_automation object by its id - **Delete project**: Delete project. Delete a project object by its id - **Delete project automation**: Delete project automation. Delete a project_automation object by its id - **Delete project group**: Delete project group. Delete a project_group object by its id - **Delete project score**: Delete project score. Delete a project_score object by its id - **Delete project tag**: Delete project tag. Delete a project_tag object by its id - **Delete prompt**: Delete prompt. Delete a prompt object by its id - **Delete role**: Delete role. Delete a role object by its id - **Delete service token**: Delete service token. Delete a service_token object by its id - **Delete single acl**: Delete single acl. Delete a single acl - **Delete single ai secret**: Delete single ai secret. Delete a single ai_secret - **Delete single service token**: Delete single service token. Delete a single service_token - **Delete span iframe**: Delete span iframe. Delete a span_iframe object by its id - **Delete view**: Delete view. Delete a view object by its id - **Feedback for dataset events**: Feedback for dataset events. Log feedback for a set of dataset events - **Feedback for experiment events**: Feedback for experiment events. Log feedback for a set of experiment events - **Feedback for project logs events**: Feedback for project logs events. Log feedback for a set of project logs events - **Fetch dataset (GET form)**: Fetch dataset (GET form). Fetch the events in a dataset. Equivalent to the POST form of the same path, but with the parameters in the URL query rather than in the request body. - **Fetch dataset (POST form)**: Fetch dataset (POST form). Fetch the events in a dataset. Equivalent to the GET form of the same path, but with the parameters in the request body rather than in the URL query. - **Fetch experiment (GET form)**: Fetch experiment (GET form). Fetch the events in an experiment. Equivalent to the POST form of the same path, but with the parameters in the URL query rather than in the request body. - **Fetch experiment (POST form)**: Fetch experiment (POST form). Fetch the events in an experiment. Equivalent to the GET form of the same path, but with the parameters in the request body rather than in the URL query. - **Fetch project logs (GET form)**: Fetch project logs (GET form). Fetch the events in a project logs. Equivalent to the POST form of the same path, but with the parameters in the URL query rather than in the request body. - **Fetch project logs (POST form)**: Fetch project logs (POST form). Fetch the events in a project logs. Equivalent to the GET form of the same path, but with the parameters in the request body rather than in the URL query. - **Get acl**: Get acl. Get an acl object by its id - **Get agent**: Get agent. Get a agent object by its id - **Get ai secret**: Get ai secret. Get an ai_secret object by its id - **Get api key**: Get api key. Get an api_key object by its id - **Get dataset**: Get dataset. Get a dataset object by its id - **Get dataset snapshot**: Get dataset snapshot. Get a dataset_snapshot object by its id - **Get environment**: Get environment. - **Get env var**: Get env var. Get an env_var object by its id - **Get experiment**: Get experiment. Get an experiment object by its id - **Get function**: Get function. Get a function object by its id - **Get group**: Get group. Get a group object by its id - **Get mcp server**: Get mcp server. Get a mcp_server object by its id - **Get organization**: Get organization. Get an organization object by its id - **Get org automation**: Get org automation. Get a org_automation object by its id - **Get project**: Get project. Get a project object by its id - **Get project automation**: Get project automation. Get a project_automation object by its id - **Get project group**: Get project group. Get a project_group object by its id - **Get project score**: Get project score. Get a project_score object by its id - **Get project tag**: Get project tag. Get a project_tag object by its id - **Get prompt**: Get prompt. Get a prompt object by its id - **Get role**: Get role. Get a role object by its id - **Get service token**: Get service token. Get a service_token object by its id - **Get span iframe**: Get span iframe. Get a span_iframe object by its id - **Get user**: Get user. Get a user object by its id - **Get view**: Get view. Get a view object by its id - **Insert dataset events**: Insert dataset events. Insert a set of events into the dataset - **Insert experiment events**: Insert experiment events. Insert a set of events into the experiment - **Insert project logs events**: Insert project logs events. Insert a set of events into the project logs - **Invoke function**: Invoke function. Invoke a function. - **Launch an eval**: Launch an eval. Launch an evaluation. This is the API-equivalent of the `Eval` function that is built into the Braintrust SDK. - **List acls**: List acls. List out all acls. The acls are sorted by creation date, with the most recently-created acls coming first - **List agents**: List agents. List out all agents. The agents are sorted by creation date, with the most recently-created agents coming first - **List ai secrets**: List ai secrets. List out all ai_secrets. The ai_secrets are sorted by creation date, with the most recently-created ai_secrets coming first - **List api keys**: List api keys. List out all API keys. They are sorted by creation date, with the most recently-created keys coming first. - **List datasets**: List datasets. List out all datasets. The datasets are sorted by creation date, with the most recently-created datasets coming first - **List dataset snapshots**: List dataset snapshots. List out all dataset_snapshots. The dataset_snapshots are sorted by creation date, with the most recently-created dataset_snapshots coming first - **List environments**: List environments. List out all environments. The environments are sorted by creation date, with the most recently-created environments first. - **List env vars**: List env vars. List out all env_vars. The env_vars are sorted by creation date, with the most recently-created env_vars coming first - **List experiments**: List experiments. List out all experiments. The experiments are sorted by creation date, with the most recently-created experiments coming first - **List functions**: List functions. List out all functions. The functions are sorted by creation date, with the most recently-created functions coming first - **List groups**: List groups. List out all groups. The groups are sorted by creation date, with the most recently-created groups coming first - **List mcp servers**: List mcp servers. List out all mcp_servers. The mcp_servers are sorted by creation date, with the most recently-created mcp_servers coming first - **List org acls**: List org acls. List all acls in the org. This query requires the caller to have `read_acls` permission at the organization level - **List organizations**: List organizations. List out all organizations. The organizations are sorted by creation date, with the most recently-created organizations coming first - **List org automations**: List org automations. List out all org_automations. The org_automations are sorted by creation date, with the most recently-created org_automations coming first - **List project automations**: List project automations. List out all project_automations. The project_automations are sorted by creation date, with the most recently-created project_automations coming first - **List project groups**: List project groups. List out all project_groups. The project_groups are sorted by creation date, with the most recently-created project_groups coming first - **List projects**: List projects. List out all projects. The projects are sorted by creation date, with the most recently-created projects coming first - **List project scores**: List project scores. List out all project_scores. The project_scores are sorted by creation date, with the most recently-created project_scores coming first - **List project tags**: List project tags. List out all project_tags. The project_tags are sorted by creation date, with the most recently-created project_tags coming first - **List prompts**: List prompts. List out all prompts. The prompts are sorted by creation date, with the most recently-created prompts coming first - **List roles**: List roles. List out all roles. The roles are sorted by creation date, with the most recently-created roles coming first - **List service tokens**: List service tokens. List out all service tokens. They are sorted by creation date, with the most recently-created tokens coming first. - **List span iframes**: List span iframes. List out all span_iframes. The span_iframes are sorted by creation date, with the most recently-created span_iframes coming first - **List users**: List users. List out all users. The users are sorted by creation date, with the most recently-created users coming first - **List views**: List views. List out all views. The views are sorted by creation date, with the most recently-created views coming first - **Modify organization membership**: Modify organization membership. Add or remove members, create service accounts. - **Partially update agent**: Partially update agent. Partially update a agent object. Specify the fields to update in the payload. - **Partially update ai secret**: Partially update ai secret. Partially update an ai_secret object. Specify the fields to update in the payload. - **Partially update dataset**: Partially update dataset. Partially update a dataset object. Specify the fields to update in the payload. - **Partially update dataset snapshot**: Partially update dataset snapshot. Partially update a dataset_snapshot object. Specify the fields to update in the payload. - **Partially update environment**: Partially update environment. - **Partially update env var**: Partially update env var. Partially update an env_var object. Specify the fields to update in the payload. - **Partially update experiment**: Partially update experiment. Partially update an experiment object. Specify the fields to update in the payload. - **Partially update function**: Partially update function. Partially update a function object. Specify the fields to update in the payload. - **Partially update group**: Partially update group. Partially update a group object. Specify the fields to update in the payload. - **Partially update mcp server**: Partially update mcp server. Partially update a mcp_server object. Specify the fields to update in the payload. - **Partially update organization**: Partially update organization. Partially update an organization object. Specify the fields to update in the payload. - **Partially update org automation**: Partially update org automation. Partially update a org_automation object. Specify the fields to update in the payload. - **Partially update project**: Partially update project. Partially update a project object. Specify the fields to update in the payload. - **Partially update project automation**: Partially update project automation. Partially update a project_automation object. Specify the fields to update in the payload. - **Partially update project group**: Partially update project group. Partially update a project_group object. Specify the fields to update in the payload. - **Partially update project score**: Partially update project score. Partially update a project_score object. Specify the fields to update in the payload. - **Partially update project tag**: Partially update project tag. Partially update a project_tag object. Specify the fields to update in the payload. - **Partially update prompt**: Partially update prompt. Partially update a prompt object. Specify the fields to update in the payload. - **Partially update role**: Partially update role. Partially update a role object. Specify the fields to update in the payload. - **Partially update span iframe**: Partially update span iframe. Partially update a span_iframe object. Specify the fields to update in the payload. - **Partially update view**: Partially update view. Partially update a view object. Specify the fields to update in the payload. - **Proxy a model to chat/completions or completions automatically**: Proxy a model to chat/completions or completions automatically. Proxy a request to either chat/completions or completions automatically based on the model. Will cache if temperature=0 or seed is set. - **Proxy any OpenAI request (fallback)**: Proxy any OpenAI request (fallback). Any requests which do not match the above paths will be proxied directly to the OpenAI API. - **Proxy chat/completions**: Proxy chat/completions. Proxy a chat/completions request to the specified model, converting its format as needed. Will cache if temperature=0 or seed is set. - **Proxy completions**: Proxy completions. Proxy a completions request to the specified model, converting its format as needed. Will cache if temperature=0 or seed is set. - **Proxy embeddings**: Proxy embeddings. Proxy an embeddings request to the specified model, converting its format as needed. Will cache automatically. - **Query with SQL**: Run a SQL query over project logs, experiments and datasets and get rows back (BTQL endpoint). - **Summarize dataset**: Summarize dataset. - **Summarize experiment**: Summarize experiment. Connect Braintrust in General Input: https://www.generalinput.com/apps/braintrust