Skip to main content
POST
Create Evaluation Criteria Version

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

project_id
string
required
criteria_id
string
required

Body

application/json
name
string
required
target_type
enum<string>
required
Available options:
prompt,
agent
target_id
string<uuid>
required
llm_eval_enabled
boolean
required
sample_rate
number | null
model_id
string<uuid> | null
model
string | null
provider
string | null
type
enum<string> | null
Available options:
1-5,
1-3,
1-100,
yes-no,
multi-select,
text,
auto-categorization,
code-bool,
code-float
question
string | null
llm_question
string | null
rubric
Rubric · object | null
multi_select_labels
string[] | null
description
string | null
categories
AutoCategorizationCategoryInfo · object[] | null
auto_categorization_references
string[] | null
auto_categorization_allow_multiple_categories
boolean
default:false
create_criteria_if_missing
boolean
default:false
criteria_id
string<uuid> | null
overwrite_latest_version
boolean
default:false
generate_insights
boolean
default:true

Response

201 - application/json

Frozen copy of the old flat EvaluationCriteriaVersionInfo shape for backward-compatible public API.

id
string<uuid>
required
version_id
string<uuid>
required
name
string
required
question
string
required
llm_question
string | null
required
llm_eval_enabled
boolean
required
type
enum<string>
required
Available options:
1-5,
1-3,
1-100,
yes-no,
multi-select,
text,
auto-categorization,
code-bool,
code-float
rubric
Rubric · object
required
multi_select_labels
string[]
required
version_number
integer
required
is_deployed
boolean
required
created_at
integer
required
sample_rate
number | null
required
target
EvaluationCriteriaTarget · object
required
created_by_user
UserInfo · object | null
required
alignment_score
AlignmentScore · object | null
options
model_id
string<uuid> | null
model_name
string | null
position
number | null
is_enabled
boolean
default:true
generate_insights
boolean
default:true
criteria_description
string | null
references
string[] | null
allow_multiple_categories
boolean
default:false
categories
AutoCategorizationCategoryInfo · object[] | null
eval_code
string | null
language
enum<string> | null
Available options:
python,
typescript
pass_score