Create 2

POST

https://api.respan.ai/evaluations/:evaluator_id/

POST

/evaluations/:evaluator_id/

$ curl -X POST https://api.respan.ai/evaluations/evaluator_id/ \
>      -H "Authorization: Bearer <token>" \
>      -H "Content-Type: application/json" \
>      -d '{
>   "name": "string"
> }'

200Successful

1 {
2   "is_public": true,
3   "created_by": {
4     "id": 1,
5     "email": "string",
6     "name": "string",
7     "username": "string",
8     "first_name": "string",
9     "last_name": "string"
10   },
11   "updated_by": {
12     "id": 1,
13     "email": "string",
14     "name": "string",
15     "username": "string",
16     "first_name": "string",
17     "last_name": "string"
18   },
19   "editor": {
20     "id": 1,
21     "email": "string",
22     "name": "string",
23     "username": "string",
24     "first_name": "string",
25     "last_name": "string"
26   },
27   "name": "string",
28   "created_at": "2024-01-15T09:30:00Z",
29   "updated_at": "2024-01-15T09:30:00Z",
30   "version_id": "string",
31   "configurations": {},
32   "categorical_choices": [
33     {}
34   ],
35   "score_config": {},
36   "passing_conditions": {},
37   "llm_config": {},
38   "code_config": {},
39   "project": "string",
40   "eval_class": "string",
41   "id": "string",
42   "version": 1,
43   "is_read_only": true,
44   "version_description": "string",
45   "evaluator_slug": "string",
46   "description": "string",
47   "type": "llm",
48   "score_value_type": "numerical",
49   "custom_required_fields": [
50     "string"
51   ],
52   "starred": true
53 }

POST handler with superadmin-only field protection.

Strips superadmin-only fields from non-superadmin requests before delegating to OrganizationInjectionMixin.post() for org injection.

Authentication

AuthorizationBearer

JWT access token or Respan API key

Path parameters

evaluator_idstringRequired

Request

This endpoint expects an object.

namestringRequired1-255 characters

version_idstringOptional1-255 characters

configurationsmap from strings to anyOptional

categorical_choiceslist of maps from strings to anyOptional

score_configmap from strings to anyOptional

passing_conditionsmap from strings to any or nullOptional

llm_configmap from strings to any or nullOptional

code_configmap from strings to any or nullOptional

projectstring or nullOptional>=1 character

eval_classstringOptional>=1 character

idstringOptional1-255 characters

versionintegerOptional-2147483648-2147483647

is_read_onlybooleanOptional

version_descriptionstringOptional

evaluator_slugstringOptional<=255 characters

unique_organization_idstring or nullOptional<=255 characters

descriptionstringOptional

typeenumOptional

llm - Llm
code - Code
human - Human
function - Function
human_numerical - Human Numerical
human_categorical - Human Categorical
human_boolean - Human Boolean
human_text - Human Text
custom - Custom

score_value_typeenumOptional

numerical - Numerical
boolean - Boolean
percentage - Percentage
single_select - Single Select
multi_select - Multi Select
text - Text
json - Json
comment - Comment
categorical - Categorical

custom_required_fieldslist of stringsOptional

starredbooleanOptional

organizationinteger or nullOptional

Response

is_publicbooleanRead-only

created_byobject

updated_byobject

editorobject

namestring<=255 characters

created_atdatetimeRead-only

updated_atdatetimeRead-only

version_idstring<=255 characters

configurationsmap from strings to any

categorical_choiceslist of maps from strings to any

score_configmap from strings to any

passing_conditionsmap from strings to any or null

llm_configmap from strings to any or null

code_configmap from strings to any or null

projectstring or null

eval_classstring

idstring<=255 characters

versioninteger-2147483648-2147483647

is_read_onlyboolean

version_descriptionstring

evaluator_slugstring<=255 characters

descriptionstring

typeenum

llm - Llm
code - Code
human - Human
function - Function
human_numerical - Human Numerical
human_categorical - Human Categorical
human_boolean - Human Boolean
human_text - Human Text
custom - Custom

score_value_typeenum

numerical - Numerical
boolean - Boolean
percentage - Percentage
single_select - Single Select
multi_select - Multi Select
text - Text
json - Json
comment - Comment
categorical - Categorical

custom_required_fieldslist of strings

starredboolean