API ReferenceEvaluations

Evaluators Versions Create

Create a new version (commit). Org derived from parent evaluator.

Authentication

AuthorizationBearer
JWT access token or Respan API key

Path parameters

evaluator_idstringRequired

Request

This endpoint expects an object.
configurationsmap from strings to anyOptional
categorical_choiceslist of maps from strings to anyOptional
score_configmap from strings to anyOptional
passing_conditionsmap from strings to any or nullOptional
llm_configmap from strings to any or nullOptional
code_configmap from strings to any or nullOptional
projectstring or nullOptional>=1 character
namestringOptional>=1 character
score_value_typestringOptional>=1 character
version_descriptionstringOptionalDefaults to
descriptionstringOptional
typeenumOptional
  • llm - Llm
  • code - Code
  • human - Human
  • function - Function
  • human_numerical - Human Numerical
  • human_categorical - Human Categorical
  • human_boolean - Human Boolean
  • human_text - Human Text
  • custom - Custom
eval_classenumOptional
custom_required_fieldslist of stringsOptional
starredbooleanOptional
created_byinteger or nullOptional
updated_byinteger or nullOptional

Response

version_idstringRead-only
is_publicbooleanRead-only
idstringRead-only
versionintegerRead-only
is_read_onlybooleanRead-only
created_atdatetimeRead-only
updated_atdatetimeRead-only
configurationsmap from strings to any
categorical_choiceslist of maps from strings to any
score_configmap from strings to any
passing_conditionsmap from strings to any or null
llm_configmap from strings to any or null
code_configmap from strings to any or null
projectstring or null
namestring
score_value_typestring
version_descriptionstringDefaults to
descriptionstring
typeenum
  • llm - Llm
  • code - Code
  • human - Human
  • function - Function
  • human_numerical - Human Numerical
  • human_categorical - Human Categorical
  • human_boolean - Human Boolean
  • human_text - Human Text
  • custom - Custom
eval_classenum
custom_required_fieldslist of strings
starredboolean
created_byinteger or null
updated_byinteger or null