GPU providers

Veri runs training jobs on four GPU providers. You pick one at job submit time with the provider field. Each provider offers different GPU types at different price points — AWS is the default, Vast.ai is the NVIDIA marketplace spillover, DigitalOcean offers single-GPU H100 droplets with per-second billing, and Hot Aisle (AMD MI300X) is coming soon.

Providers at a glance

Provider	GPUs offered	Architecture	Billing	Status
`aws` (default)	L4, A10G, A100 80GB, H100 80GB	NVIDIA (Ampere/Hopper)	Per-second, on-demand or spot	Available
`hotaisle`	MI300X 192GB	AMD (CDNA3 / ROCm)	Per-hour, on-demand	Coming soon
`vast`	A100 80GB, H100 80GB	NVIDIA (marketplace)	Per-second, marketplace pricing	Available
`digitalocean`	H100 80GB	NVIDIA (Hopper)	Per-second, on-demand	Available

All providers except AWS are gated behind feature flags that may be off in your environment. If a provider is disabled, submit returns a “coming soon” 400. Run veri gpu list to see which providers are live.

Choosing a provider

Pass provider when creating a training job:

from veri_sdk import Client
client = Client()

job = client.training_jobs.create(
    base_model="Qwen/Qwen2.5-0.5B-Instruct",
    dataset_id=dataset.id,
    reward_source=open("reward.py").read(),
    output_name="qwen-0.5b-amd",
    method="grpo",
    gpu_type="MI300X-192GB",
    gpu_count=1,
    provider="hotaisle",
    hyperparameters={
        "learning_rate": 1e-6,
        "max_steps": 50,
    },
)

From the CLI:

veri train --provider hotaisle --gpu-type MI300X-192GB --gpu-count 1

Or in a TOML config:

kind = "train"
provider = "hotaisle"
gpu_type = "MI300X-192GB"
gpu_count = 1

Omit provider to use the default (AWS).

Checking live availability

Capacity is per-provider and per-region. Check what’s available right now before submitting:

veri gpu list                    # all providers, all regions
veri gpu list --provider hotaisle  # Hot Aisle only
veri gpu list --provider vast     # Vast.ai only
veri gpu list --provider digitalocean  # DigitalOcean only
veri gpu list --gpu-type MI300X-192GB  # filter by GPU type

The available column shows live capacity: a real-time count of GPUs that can be launched immediately. 0 means the shape is offered but currently out of stock — retry later.

Pricing

Each provider has its own rate card. Check current pricing with:

veri gpu list --format json   # includes usd_per_hour per GPU type

Rates are per-GPU-hour. You are billed from when the GPU is provisioned (provisioning state) until the job terminates and the instance is reaped. A job that never secures a GPU (e.g. CAPACITY_UNAVAILABLE) is not billed.

Provider guides

AWS (default)

L4, A10G, and whole-node A100/H100 — the reliable NVIDIA default.

Hot Aisle (AMD MI300X)

192 GB HBM3 per card, the ROCm stack, and MI300X performance tuning.

Vast.ai

Marketplace A100/H100 spillover at fluctuating prices.

DigitalOcean

Fast-provisioning 1x/8x H100 droplets with per-second billing.

Where to go next

Managed training

How the training loop works across all providers.

GRPO algorithm

The default RL method — works on all providers.

Get started

Training

Deployments

CLI

Volumes

Webhooks

Providers at a glance

Choosing a provider

Checking live availability

Pricing

Provider guides

AWS (default)

Hot Aisle (AMD MI300X)

Vast.ai

DigitalOcean

Where to go next

Managed training

GRPO algorithm

​Providers at a glance

​Choosing a provider

​Checking live availability

​Pricing

​Provider guides

AWS (default)

Hot Aisle (AMD MI300X)

Vast.ai

DigitalOcean

​Where to go next

Managed training

GRPO algorithm

Providers at a glance

Choosing a provider

Checking live availability

Pricing

Provider guides

Where to go next