Braintrust
AI evals and observability: projects, experiments, datasets, logs, prompts, functions, scorers and access control, plus SQL queries over traces.
Free account. No credit card required.
Three ways to use Braintrust
Ask your specialist
Pull data, take actions, or answer questions with this integration, right in a conversation.
Build a workflow
Create automated workflows that trigger on events, run on a schedule, or chain multiple tools together.
Power an app
Use this integration as a data source or action layer behind a dashboard, form, or internal tool.
Supported tools
Actions your AI agents can perform with Braintrust.
Batch update acls
Batch update acls. Batch update acls. This operation is idempotent, so adding acls which already exist will have no effect, and removing acls which do not exist will have no effect.
Check API reachability
Hello world endpoint. Default endpoint. Simply replies with 'Hello, World!'.
Create acl
Create acl. Create a new acl. If there is an existing acl with the same contents as the one specified in the request, will return the existing acl unmodified
Create agent
Create agent. Create a new agent. If there is an existing agent with the same name as the one specified in the request, will return the existing agent unmodified
Create ai secret
Create ai secret. Create a new ai_secret. If there is an existing ai_secret with the same name as the one specified in the request, will return the existing ai_secret unmodified
Create dataset
Create dataset. Create a new dataset. If there is an existing dataset in the project with the same name as the one specified in the request, will return the existing dataset unmodified