Skip to main content
POST
Create Code Evaluation Criteria

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

project_id
string
required

Body

application/json
name
string
required
description
string
required
target_type
enum<string>
required
Available options:
prompt,
agent
target_id
string<uuid>
required
eval_code
string
required
criteria_type
enum<string>
required
Available options:
1-5,
1-3,
1-100,
yes-no,
multi-select,
text,
auto-categorization,
code-bool,
code-float
sample_rate
number
default:0
generate_insights
boolean
default:true
language
enum<string>
default:python
Available options:
python,
typescript

Response

201 - application/json

CreateCodeEvalResponse(id: uuid.UUID, name: str, description: Optional[str], target_type: shared.common.TargetType, target_id: uuid.UUID, criteria_type: shared.sqlalchemy.models.AutoEvalCriteriaType, sample_rate: Optional[float], is_enabled: bool, generate_insights: bool, deployed_version: server.api_routes.code_eval_criteria_api_v2.CodeEvalVersionSummary, latest_version: server.api_routes.code_eval_criteria_api_v2.CodeEvalVersionSummary)

id
string<uuid>
required
name
string
required
description
string | null
required
target_type
enum<string>
required
Available options:
prompt,
agent
target_id
string<uuid>
required
criteria_type
enum<string>
required
Available options:
1-5,
1-3,
1-100,
yes-no,
multi-select,
text,
auto-categorization,
code-bool,
code-float
sample_rate
number | null
required
is_enabled
boolean
required
generate_insights
boolean
required
deployed_version
CodeEvalVersionSummary · object
required
latest_version
CodeEvalVersionSummary · object
required