Run evaluators on a dataset

Create dataset evaluation tasks for one or more evaluators.

dataset_idstringRequired

Dataset ID.

This endpoint expects an object.

evaluator_idslist of stringsRequired

Evaluator IDs to run against the dataset.

experiment_idstringOptional

Optional experiment to associate with the evaluation runs.

generation_methodstringOptional

Optional generation strategy. Defaults to auto.

Evaluation tasks created.

created_taskslist of objects

errorsmap from strings to any

experiment_updatedboolean

experiment_evaluator_idslist of strings

400

Bad Request Error

401

Unauthorized Error

404

Not Found Error

1	curl -X POST https://api.respan.ai/api/datasets/dataset_id/eval-reports/create/ \
2	-H "Authorization: Bearer sk_live_xxxxx" \
3	-H "Content-Type: application/json" \
4	-d '{
5	"evaluator_ids": [
6	"eval_abc123"
7	]
8	}'

1	{
2	"created_tasks": [
3	{
4	"task_id": "task_01J6ABCDEF",
5	"name": "Run evaluator accuracy on dataset Support Conversations - July",
6	"dataset_id": "6d0b2c7e-3a6a-4c09-9c7e-1f2d9e2d3f0a",
7	"evaluator_slug": "accuracy",
8	"status": "pending",
9	"error_message": ""
10	}
11	],
12	"experiment_updated": false
13	}