Vast.ai

​

GPU types

​

Submitting a job

job = client.training_jobs.create(
    base_model="Qwen/Qwen2.5-0.5B-Instruct",
    dataset_id=dataset.id,
    reward_function_id=reward_fn.id,
    gpu_type="H100-80GB",
    gpu_count=1,
    provider="vast",
)

​

Notes

• Vast.ai rents individual GPU cards on shared hosts, so gpu_count=1 rents exactly one GPU (unlike AWS where A100/H100 are whole 8-GPU nodes).
• Availability and pricing vary by host and fluctuate in real time — check veri gpu list --provider vast before submitting.
• A submit that finds no acceptable offer fails with CAPACITY_UNAVAILABLE and is not billed.

​

Where to go next