List evaluators | Respan Docs

curl https://api.respan.ai/api/evaluators/ \
     -H "Authorization: Bearer sk_live_xxxxx" \
     -H "Content-Type: application/json"

{
  "count": 1,
  "results": [
    {
      "id": "evl_9f8b7c6d",
      "name": "Response Quality",
      "type": "llm",
      "score_value_type": "numerical",
      "version_id": "evlv_9f8b7c6d_v2",
      "version": 2,
      "is_read_only": true,
      "version_description": "Refined scoring criteria for clarity",
      "evaluator_slug": "response_quality",
      "eval_class": "keywordsai_custom_llm",
      "description": "Grades whether the response is accurate and complete.",
      "score_config": {
        "min_score": 1,
        "max_score": 5,
        "choices": [
          {
            "name": "Excellent",
            "value": "excellent"
          },
          {
            "name": "Good",
            "value": "good"
          },
          {
            "name": "Fair",
            "value": "fair"
          },
          {
            "name": "Poor",
            "value": "poor"
          }
        ]
      },
      "passing_conditions": {
        "primary_score": {
          "operator": "gte",
          "value": 3
        }
      },
      "llm_config": {
        "model": "gpt-4o-mini",
        "evaluator_definition": "Rate the response quality.\n<input>{{input}}</input>\n<output>{{output}}</output>",
        "scoring_rubric": "1=Poor, 5=Excellent",
        "temperature": 0.1,
        "max_tokens": 200,
        "top_p": 0.9,
        "frequency_penalty": 0.2,
        "presence_penalty": 0.3,
        "stop": [
          "\n"
        ],
        "response_format": {},
        "tools": [
          {}
        ],
        "verbosity": "detailed"
      },
      "code_config": {
        "eval_code_snippet": "def main(eval_inputs):\n    return 1 if eval_inputs.get('output') else 0"
      },
      "configurations": {},
      "categorical_choices": [
        {
          "name": "Excellent",
          "value": "excellent"
        },
        {
          "name": "Good",
          "value": "good"
        },
        {
          "name": "Fair",
          "value": "fair"
        },
        {
          "name": "Poor",
          "value": "poor"
        }
      ],
      "starred": false,
      "created_at": "2024-04-10T14:22:00Z",
      "updated_at": "2024-05-01T11:15:00Z",
      "created_by": {
        "id": 42,
        "first_name": "Alice",
        "last_name": "Johnson",
        "email": "alice.johnson@respan.ai"
      },
      "updated_by": {
        "id": 57,
        "first_name": "Bob",
        "last_name": "Smith",
        "email": "bob.smith@respan.ai"
      },
      "editor": {
        "id": 57,
        "first_name": "Bob",
        "last_name": "Smith",
        "email": "bob.smith@respan.ai"
      },
      "tags": [
        {
          "id": 3,
          "name": "Quality",
          "color": "#4CAF50"
        },
        {
          "id": 7,
          "name": "LLM",
          "color": "#2196F3"
        }
      ]
    }
  ],
  "current_filters": {}
}

List the current draft/latest evaluator for each evaluator ID. This route supports simple pagination and name search. Use POST /api/evaluators/list/ when you need the full filter format.

Query parameters

pageintegerOptional>=1

Page number.

page_sizeintegerOptional1-100

Number of results to return per page. Maximum 100.

searchstringOptional

Search evaluator names.

Response

Paginated evaluator list.

countinteger

Number of resources returned on this page.

resultslist of objects

nextstring or null

URL for the next page, if any.

previousstring or null

URL for the previous page, if any.

current_filtersobject

Normalized filters applied to this request.

Errors

401

Unauthorized Error

Headers

Query parameters

Response

Errors