Serving providers

Deployments run on AWS by default, or on DigitalOcean for single-GPU H100 and H200. The provider field defaults to aws, so you can leave it out. Capacity errors don’t spill to another cloud: retry later or pick another GPU shape.

Providers at a glance

Provider	`gpu_type`	Memory	GPUs per node	Status
`aws` (default)	`L4-24GB`	24 GB	1 or 4	Available
`aws` (default)	`A10G-24GB`	24 GB	1 or 4	Available
`aws` (default)	`A100-80GB`	80 GB	8 (whole node)	Available
`aws` (default)	`H100-80GB`	80 GB	8 (whole node)	Available
`digitalocean`	`H100-80GB`	80 GB	1	Available (capacity varies)
`digitalocean`	`H200-141GB`	141 GB	1	Available

Each provider sells fixed node shapes. The gpu_count you request must match one of the counts above — asking for a shape a provider doesn’t sell returns a 400 at create, before anything boots.

Other serving providers are not available yet: a create with any other provider returns 400 with Serving provider '<provider>' is not currently enabled.

Choosing a provider

client.deployments.create(
    model="Qwen/Qwen2.5-0.5B-Instruct",
    source="huggingface",
    name="my-deploy",
    gpu={"gpu_type": "L4-24GB", "gpu_count": 1},
    provider="aws",
)

Omit provider to use the default (AWS).

Checking providers from the CLI

The live version of the matrix above (including current prices) is one command:

veri gpu list

This renders the GPU catalog: one row per (GPU type, provider) with a training and a serving column: the node counts you can order for each workload (- = not offered, (soon) = not available yet) and the per-GPU $/hr. Any filter switches to the live availability view:

veri gpu list --gpu-type H100-80GB      # one SKU across providers
veri gpu list --provider digitalocean   # per-region droplet capacity
veri gpu list --format json             # machine-readable catalog, incl. usd_per_gpu_hr

In that view, a status of AVAILABLE is a live signal (DigitalOcean per-region catalog, Vast offers); OFFERED (AWS) is catalog plus a Spot placement-score proxy, not a launch guarantee.

Get started

Training

Deployments

Evaluations

Agents

CLI

Volumes

Webhooks

Secrets

Billing

Providers at a glance

Choosing a provider

Checking providers from the CLI

Provider guides

AWS (default)

Where to go next

Hosting & GPU sizing

Billing

​Providers at a glance

​Choosing a provider

​Checking providers from the CLI

​Provider guides

AWS (default)

​Where to go next

Hosting & GPU sizing

Billing

Providers at a glance

Choosing a provider

Checking providers from the CLI

Provider guides

Where to go next