Your own GPUs, rented GPUs, and cloud instances: utilization and cost per hour.
| Host | Tier | SKU | Region | Workload | GPUs | Rate | vs mkt | Util | Cost | Daily util |
|---|---|---|---|---|---|---|---|---|---|---|
| aws-p5-us-east-1a AWS | Hyperscaler | H100 SXM 80GB | us-east-1 | inference | 8 | $4.10 | +33% | 53% | $23.6K |
| azure-nd-h100-v5 Azure | Hyperscaler | H100 SXM 80GB | eastus2 | training | 8 | $3.90 | +26% | 42% | $22.5K |
| gcp-a3-highgpu GCP | Hyperscaler | H100 SXM 80GB | us-central1 | batch | 8 | $3.60 | +17% | 27% | $20.7K |
| dgx-h100-01 Jump DC-1 | Owned | H100 SXM 80GB | Columbus, OH | inference | 8 | $2.10 | -32% | 62% | $12.1K |
| dgx-h100-02 Jump DC-1 | Owned | H100 SXM 80GB | Columbus, OH | training | 8 | $2.10 | -32% | 25% | $12.1K |
| vast-h100-a Vast.ai | Distributed | H100 SXM 80GB | Dallas, TX | inference | 8 | $1.92 | -38% | 77% | $11.1K |
| hgx-a100-01 Jump DC-1 | Owned | A100 SXM 80GB | Columbus, OH | batch | 8 | $1.05 | -48% | 24% | $6.05K |
| vast-4090-b Vast.ai | Distributed | RTX 4090 24GB | Warsaw, PL | batch | 12 | $0.33 | -8% | 67% | $2.85K |
| l40s-edge-01 Jump DC-1 | Owned | L40S 48GB | Columbus, OH | dev | 4 | $0.55 | -29% | 14% | $1.58K |