# Weights & Biases integration

> ML experiment tracking and LLM observability: Weave traces, calls, evaluations, datasets, and feedback.

- Authentication: apiKey

## Tools (116)

- **Annotation Queue Add Calls**: Add calls to an annotation queue.
- **Annotation Queue Create**: Create a new annotation queue.
- **Annotation Queue Delete**: Delete (soft-delete) an annotation queue.
- **Annotation Queue Item Progress Update**: Update the annotation state of a queue item for the current annotator.
- **Annotation Queue Items Query**: Query items in an annotation queue with pagination and sorting.
- **Annotation Queue Read**: Read a specific annotation queue.
- **Annotation Queues Query Stream**: Query annotation queues for a project (streaming NDJSON response).
- **Annotation Queues Stats**: Get stats for multiple annotation queues.
- **Annotation Queue Update**: Update an annotation queue's metadata (name, description, scorer_refs).
- **Call End**: Weave Service API, Calls: Call End.
- **Call Read**: Weave Service API, Calls: Call Read.
- **Calls Complete**: Upsert a batch of completed calls directly to the calls_complete table.
- **Calls Delete**: Weave Service API, Calls: Calls Delete.
- **Calls Query Stats**: Weave Service API, Calls: Calls Query Stats.
- **Calls Query Stream**: Weave Service API, Calls: Calls Query Stream.
- **Calls Score**: Weave Service API, Scores: Calls Score.
- **Call Start**: Weave Service API, Calls: Call Start.
- **Call Start Batch**: Weave Service API, Calls: Call Start Batch.
- **Call Stats**: Weave Service API, Calls: Call Stats.
- **Calls Usage**: Compute aggregated usage for multiple root calls, with descendant rollup.
- **Call Update**: Weave Service API, Calls: Call Update.
- **Cost Create**: Weave Service API, Costs: Cost Create.
- **Cost Purge**: Weave Service API, Costs: Cost Purge.
- **Cost Query**: Weave Service API, Costs: Cost Query.
- **Custom Runtime Apply**: Create or replace a custom runtime configuration.
- **Dataset Create**: Create a dataset object.
- **Dataset Delete**: Delete a dataset object.
- **Dataset List**: List dataset objects.
- **Dataset Read**: Get a dataset object.
- **Eval Results Query**: Read grouped evaluation result rows for one or more evaluations.
- **Evaluate Model**: Weave Service API, Evaluations: Evaluate Model.
- **Evaluation Create**: Create an evaluation object.
- **Evaluation Delete**: Delete an evaluation object.
- **Evaluation List**: List evaluation objects.
- **Evaluation Read**: Get an evaluation object.
- **Evaluation Run Create**: Create an evaluation run.
- **Evaluation Run Delete**: Delete evaluation runs.
- **Evaluation Run Finish**: Finish an evaluation run.
- **Evaluation Run List**: List evaluation runs.
- **Evaluation Run Read**: Read an evaluation run.
- **Evaluation Status**: Weave Service API, Evaluations: Evaluation Status.
- **Export Genai Trace**: Ingest OTel spans into the GenAI observability system.
- **Export Trace**: Weave Service API, OpenTelemetry: Export Trace.
- **Feedback Aggregate**: Aggregate typed scorer feedback (tags, ratings) over time buckets.
- **Feedback Create**: Add feedback to a call or object.
- **Feedback Create Batch**: Add multiple feedback items to calls or objects.
- **Feedback Payload Schema**: Discover feedback payload schema (paths and types) from sample rows.
- **Feedback Purge**: Permanently delete feedback.
- **Feedback Query**: Query for feedback.
- **Feedback Replace**: Weave Service API, Feedback: Feedback Replace.
- **Feedback Stats**: Return aggregated feedback statistics over time buckets.
- **File Content**: Weave Service API, Files: File Content.
- **File Create**: Weave Service API, Files: File Create.
- **Files Stats**: Weave Service API, Files: Files Stats.
- **Genai Agents Query**: Weave Service API, Agents: Genai Agents Query.
- **Genai Agent Versions Query**: Weave Service API, Agents: Genai Agent Versions Query.
- **Genai Conversation Chat**: Weave Service API, Agents: Genai Conversation Chat.
- **Genai Conversation Spans**: Weave Service API, Agents: Genai Conversation Spans.
- **Genai Custom Attrs Schema**: Discover typed custom attribute keys on matching agent spans.
- **Genai Search**: Weave Service API, Agents: Genai Search.
- **Genai Spans Query**: Query agent spans, either as raw rows or grouped aggregates.
- **Genai Spans Stats**: Query chart-ready aggregations over agent spans.
- **Genai Traces Chat**: Weave Service API, Agents: Genai Traces Chat.
- **Get Caller Location**: Lookup the geographic location of a user based on their IP address.
- **Get Server Info**: Weave Service API, Service: Get Server Info.
- **Get Version**: Weave Service API, Service: Get Version.
- **Health Check**: Weave Service API, Service: Health Check.
- **Image Create**: Weave Service API, Images: Image Create.
- **Inference Analysis Artificialanalysis Models**: Returns a list of available models for Artificial Analysis.
- **Inference Catalog Models**: Returns a list of available Serverless Inference models.
- **Inference Modelsdev Models**: Returns the available models in the models.dev `api.json` schema.
- **Inference Router Openrouter Models**: Returns a list of models that are available to be used with OpenRouter.
- **Link To Registry**: Weave Service API, Registry: Link To Registry.
- **List Aliases**: List all aliases in a project.
- **List Tags**: List all tags in a project.
- **Model Create**: Create a model object.
- **Model Delete**: Delete a model object.
- **Model List**: List model objects.
- **Model Read**: Get a model object.
- **Nvidia Hardware**: Returns available hardware and pricing for a given model.
- **Obj Add Tags**: Add tags to an object version.
- **Obj Create**: Weave Service API, Objects: Obj Create.
- **Obj Delete**: Weave Service API, Objects: Obj Delete.
- **Obj Read**: Weave Service API, Objects: Obj Read.
- **Obj Remove Aliases**: Remove aliases from an object.
- **Obj Remove Tags**: Remove tags from an object version.
- **Obj Set Aliases**: Set aliases for an object version.
- **Objs Query**: Weave Service API, Objects: Objs Query.
- **Op Create**: Create an op object.
- **Op Delete**: Delete an op object.
- **Op List**: List op objects.
- **Op Read**: Get an op object.
- **Prediction Create**: Create a prediction.
- **Prediction Delete**: Delete predictions.
- **Prediction Finish**: Finish a prediction.
- **Prediction List**: List predictions.
- **Prediction Read**: Read a prediction.
- **Projects Info**: Weave Service API, Service: Projects Info.
- **Refs Read Batch**: Weave Service API, Refs: Refs Read Batch.
- **Rescore Evaluation**: Rescore an existing evaluation run with different scorer(s).
- **Score Create**: Create a score.
- **Score Delete**: Delete scores.
- **Score List**: List scores.
- **Scorer Create**: Create a scorer object.
- **Scorer Delete**: Delete a scorer object.
- **Score Read**: Read a score.
- **Scorer List**: List scorer objects.
- **Scorer Read**: Get a scorer object.
- **Table Create**: Weave Service API, Tables: Table Create.
- **Table Create From Digests**: Weave Service API, Tables: Table Create From Digests.
- **Table Query**: Weave Service API, Tables: Table Query.
- **Table Query Stats**: Weave Service API, Tables: Table Query Stats.
- **Table Query Stats Batch**: Weave Service API, Tables: Table Query Stats Batch.
- **Table Update**: Weave Service API, Tables: Table Update.
- **Threads Query Stream**: Weave Service API, Threads: Threads Query Stream.
- **Trace Usage**: Compute per-call usage for a trace, with descendant rollup.

Connect Weights & Biases in General Input: https://www.generalinput.com/apps/weights-and-biases