Getting Started
Observability
Search & Analytics
Prompt Templates
- GETList prompt template versions
- POSTCreate prompt template version by ID
- GETGet prompt template version by ID
- POSTGet bound prompt template version by ID
- DELDelete prompt template version
- POSTUpdate environment for prompt template version
- POSTCreate prompt template version by name
- GETList prompt templates
- POSTCreate prompt template
- GETGet all prompt templates by environment
- GETGet prompt template
- DELDelete prompt template
- PATCHUpdate prompt template
- GETGet prompt template by name and environment
- POSTGet bound prompt template by name and environment
Insights
Evaluation Criteria
- GETList Evaluation Criteria
- POSTCreate Evaluation Criteria
- GETList Code Evaluation Criteria
- POSTCreate Code Evaluation Criteria
- GETGet Code Evaluation Criteria
- DELDelete Code Evaluation Criteria
- PATCHUpdate Code Evaluation Criteria
- PATCHDisable Code Evaluation Criteria
- PATCHEnable Code Evaluation Criteria
- GETList Code Evaluation Criteria Versions
- POSTCreate Code Evaluation Criteria Version
- GETGet Code Evaluation Criteria Version
- POSTPublish Code Evaluation Criteria Version
- GETGet Evaluation Criteria
- DELDelete Evaluation Criteria
- PATCHDisable Criteria
- PATCHEnable Criteria
- PATCHReorder Criteria
- GETList Evaluation Criteria Versions
- POSTCreate Evaluation Criteria Version
- GETGet Evaluation Criteria Version
- DELDelete Evaluation Criteria Version
- POSTDeploy Evaluation Criteria Version
- POSTExecute Evals for Completion
- POSTExecute Evals for Trace
Prompt Datasets
- GETList Prompt Test Cases
- POSTUpload Prompt Test Cases
- GETList Prompt Test Cases by Dataset Name
- GETList Prompt Test Cases
- POSTBulk Create Prompt Test Cases
- DELBulk Delete Prompt Test Cases
- GETGet Prompt Test Case
- DELDelete Prompt Test Case
- PATCHUpdate Prompt Test Case
- GETGet Prompt Dataset
- GETGet Prompt Dataset by Name
- GETList Prompt Datasets
- POSTCreate Prompt-Level Dataset
- GETGet Prompt Dataset
- DELDelete Prompt Dataset
- PATCHUpdate Prompt Dataset
Agent Datasets
Configuration
- POSTCreate Project
- GETList Projects
- GETGet Project
- PUTUpdate Project
- DELDelete Project
- GETList Project Members
- POSTAdd Project Member
- DELRemove Project Member
- PATCHUpdate Project Member
- GETList Environments
- POSTCreate Environment
- DELDelete Environment
- PATCHUpdate Environment
- GETList Users
- POSTCreate User
- GETGet User
- DELDelete User
- PATCHUpdate User
Saved Searches
Prompt Optimization
Execute Evals for Trace
curl --request POST \
--url https://api.example.com/api/v2/projects/{project_id}/sessions/{session_id}/traces/{trace_id}/evaluations \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"eval_types": "all",
"criteria_ids": null
}
'{}Evaluation Criteria
Execute Evals for Trace
Queue evaluations to run against a specific trace. Evaluations are executed asynchronously.
Use the eval_types field to control which evaluations run:
all(default): Run both LLM-as-judge and code evaluationsllm-as-judge: Run only LLM-based evaluationscode: Run only code-based evaluations
Optionally pass criteria_ids to run specific evaluation criteria. When provided, those
criteria are executed regardless of whether they have already been evaluated. When omitted,
only criteria that have not yet been evaluated for this trace will run.
POST
/
api
/
v2
/
projects
/
{project_id}
/
sessions
/
{session_id}
/
traces
/
{trace_id}
/
evaluations
Execute Evals for Trace
curl --request POST \
--url https://api.example.com/api/v2/projects/{project_id}/sessions/{session_id}/traces/{trace_id}/evaluations \
--header 'Authorization: Bearer <token>' \
--header 'Content-Type: application/json' \
--data '
{
"eval_types": "all",
"criteria_ids": null
}
'{}Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
application/json
Response
202 - application/json
EmptyResponse()
The response is of type EmptyResponse · object.
⌘I