Skip to main content
GET
List benchmark catalog

Authorizations

Authorization
string
header
required

API key with the vk_ prefix. Create one from the dashboard.

Response

200 - application/json

Available benchmark tasks

task
string
required

Catalog id used as task in a benchmark scorer (e.g. "gsm8k").

name
string
required
description
string
required
tier
string
required

"inference_only" or "code_exec" (code_exec runs each sample in a sandbox).

num_samples
integer<int32>
required

Total rows in the source split; cap with sample_limit.