> ## Documentation Index > Fetch the complete documentation index at: https://docs.veri.studio/llms.txt > Use this file to discover all available pages before exploring further. # Complete a reserved item > The reviewer holding a live reservation writes one human score per pinned evaluator (source `human`, author = the caller, on the item's exact target keys, target_revision included), optionally stores a correction and appends it to an eval stream as a row, and closes the item. Everything commits together, with the `annotation.completed` webhook. ## OpenAPI ````yaml /api-reference/openapi.json post /v1/annotation-queues/{id_or_name}/items/{item_id}/complete openapi: 3.1.0 info: title: Veri API description: >- REST API for the Veri RL post-training platform. All requests require a Bearer API key (`vk_` prefix). license: name: '' version: 0.1.0 servers: - url: https://api.veri.studio description: Production security: [] tags: - name: Training jobs description: Create, monitor, and manage training jobs. - name: Datasets description: Upload and connect training datasets. - name: Deployments description: Serve trained models and run inference. - name: Volumes description: Persistent file storage mounted into jobs. - name: Models description: Custom model registry deployments serve from. - name: Regions description: Discover available launch regions. - name: GPU description: Live GPU availability by provider and region. - name: Code artifacts description: Upload custom training script bundles. - name: Billing description: Credit balance and transaction history. - name: API keys description: Create and revoke API keys. - name: Account description: The authenticated caller's identity. - name: Settings description: Account-level integrations (Weights & Biases). - name: Metrics description: Prometheus metrics export for your own observability stack. - name: Evaluators description: 'Evaluators: versioned scoring rules (LLM judge, code, human).' - name: Experiments description: >- Experiments: offline runs of a pinned dataset snapshot through a target, scored by pinned evaluators. - name: Annotation queues description: >- Human review: queue traces, threads and experiment items, reserve one at a time, score them and feed corrections back into datasets. - name: Monitors description: >- Monitors: evaluators scoring a sampled share of a deployment's live traffic. - name: Observability description: Agent conversations, agents and their traffic. - name: Public runs description: Unauthenticated reads of runs their owners published to Explore. paths: /v1/annotation-queues/{id_or_name}/items/{item_id}/complete: post: tags: - Annotation queues summary: Complete a reserved item description: >- The reviewer holding a live reservation writes one human score per pinned evaluator (source `human`, author = the caller, on the item's exact target keys, target_revision included), optionally stores a correction and appends it to an eval stream as a row, and closes the item. Everything commits together, with the `annotation.completed` webhook. operationId: complete parameters: - name: id_or_name in: path description: Queue id (aq_...) or name required: true schema: type: string - name: item_id in: path description: Item id (ai_...) required: true schema: type: string requestBody: content: application/json: schema: $ref: '#/components/schemas/CompleteRequest' required: true responses: '200': description: The completed item, its scores and the appended row content: application/json: schema: $ref: '#/components/schemas/CompleteResponse' '400': description: >- A missing, unknown or invalid score; a dataset that is not an eval stream; a correction whose trace body is unavailable; or evals disabled '404': description: No such queue, item or dataset in the caller's workspace '409': description: >- reservation_expired: the caller holds no live reservation; reserved_by_other; item_closed; score_exists security: - bearerAuth: [] components: schemas: CompleteRequest: type: object required: - scores properties: scores: type: array items: $ref: '#/components/schemas/ScoreInput' description: Exactly one score per pinned evaluator. correction: description: The corrected answer (any JSON, at most 64 KB). note: type: - string - 'null' description: At most 8 KB. append_to_dataset: type: - string - 'null' description: >- Dataset id or name: append the correction as an `eval` row ({input, output?, expected: correction, metadata: {queue, reviewer}}, or {turns, expected, metadata} for a thread) to this stream, whose format must be unset or eval. Needs `correction`. additionalProperties: false CompleteResponse: type: object required: - object - item - scores properties: object: type: string description: Always "annotation_completion". item: $ref: '#/components/schemas/AnnotationItemResponse' scores: type: array items: $ref: '#/components/schemas/ScoreResponse' description: The human scores written (source "human", author = the reviewer). dataset_row: oneOf: - type: 'null' - $ref: '#/components/schemas/AppendedRow' description: The appended dataset row, when append_to_dataset was set. ScoreInput: type: object required: - evaluator_id - value properties: evaluator_id: type: string description: A pinned evaluator's id or name. value: description: |- A boolean, one of the labels, or a number in [min, max], per the evaluator's output type. additionalProperties: false AnnotationItemResponse: type: object required: - object - id - queue_id - target_type - status - created_at properties: object: type: string description: Always "annotation_item". id: type: string description: '`ai_...`' queue_id: type: string target_type: type: string description: trace | thread | experiment_item request_id: type: - string - 'null' description: 'Trace items: the request (trace id `veri-`).' deployment_id: type: - string - 'null' description: Trace and thread items. thread_id: type: - string - 'null' description: 'Thread items: the thread and the last request under review.' target_revision: type: - string - 'null' experiment_id: type: - string - 'null' description: Experiment-item items. item_id: type: - string - 'null' status: type: string description: |- pending | reserved | completed | skipped. An expired reservation is pending. reserved_by: type: - string - 'null' description: 'While reserved: who holds it and until when.' reserved_until: type: - string - 'null' format: date-time completed_by: type: - string - 'null' description: Who closed the item (completed or skipped) and when. completed_at: type: - string - 'null' format: date-time correction: description: The reviewer's corrected answer (any JSON value). note: type: - string - 'null' created_at: type: string format: date-time ScoreResponse: type: object description: One score. required: - object - id - evaluator_id - evaluator_version - name - target_type - value - source - status - created_at properties: object: type: string description: Always "score". id: type: string description: '`scr_...`' evaluator_id: type: string evaluator_version: type: integer format: int32 name: type: string description: The evaluator's name at write time. target_type: type: string description: trace | thread request_id: type: - string - 'null' description: The scored request (trace targets). Trace id = `veri-`. deployment_id: type: - string - 'null' thread_id: type: - string - 'null' description: |- The thread (thread targets; also stamped on trace targets whose request carried a thread id). target_revision: type: - string - 'null' description: 'Thread targets: the last request id the score covers.' experiment_id: type: - string - 'null' description: 'Experiment-item targets: the experiment.' item_id: type: - string - 'null' description: |- Experiment-item targets: `.`, or `..t` for one turn of a replayed thread. value: description: boolean | label string | number; null for error and skipped scores. passed: type: - boolean - 'null' description: >- The evaluator version's pass rule applied to the value; null when the version has no pass rule or the score carries no value. reasoning: type: - string - 'null' source: type: string description: api | sdk | human | experiment | monitor status: type: string description: ok | error | skipped error: type: - string - 'null' description: Why an error / skipped score has no value. author: type: - string - 'null' description: The user who wrote the score. model_version_id: type: - string - 'null' description: The model version that answered the scored request, when known. monitor_id: type: - string - 'null' description: The monitor that wrote the score (source monitor). confidence: type: - number - 'null' format: double description: |- The judge's probability for its verdict, 0..1; null unless a decision-mode judge wrote the score. probabilities: type: - object - 'null' description: |- The Jev judge's distribution behind the value: noul `{"true": p, "false": 1 - p}`, choice `{option: p}`, score `{"": p}`. Null for every other score. created_at: type: string format: date-time AppendedRow: type: object description: The row a correction became. required: - dataset_id - row_id properties: dataset_id: type: string row_id: type: integer format: int64 securitySchemes: bearerAuth: type: http scheme: bearer bearerFormat: API key description: API key with the `vk_` prefix. Create one from the dashboard. ```` This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.