Nvidia H100
$1.11/GPU/hr
cheapest of 16 providers · Lium
- Hopper
- Released Q3 2022
- Median $2.49/GPU/hr
- $810 per 730-hour month
- 8 in stock In stock
Nvidia H100 vs Nvidia RTX 3060
Both cards cost about the same per TFLOP of FP16, so pick on memory and availability, not price.
Prices and stock checked 2 hours ago
Nvidia RTX 3060
$0.03/GPU/hr
cheapest of 2 providers · Vast.ai
- Ampere
- Released Q1 2021
- Median $0.04/GPU/hr
- $21 per 730-hour month
- 1 in stock In stock
Datasheet, side by side
Figures are the vendors' own published numbers, dense rates without sparsity. A bar is drawn only where both cards publish the same figure.
Price, side by side
| Metric | Nvidia H100 | Nvidia RTX 3060 |
|---|---|---|
| Cheapest listed | $1.11 | $0.03 |
| Median across providers | $2.49 | $0.04 |
| Most expensive listed | $5.99 | $0.06 |
| Providers | 16 | 2 |
| Reporting stock | 8 | 1 |
| One month, 730 hours | $810 | $21 |
Frequently asked questions
Is the Nvidia H100 or the Nvidia RTX 3060 cheaper to rent?
The Nvidia H100 starts at $1.11 per GPU hour and the Nvidia RTX 3060 at $0.03. Both cards cost about the same per TFLOP of FP16, so pick on memory and availability, not price.
Which one can I actually get right now?
Nvidia H100: 8 of 16 providers report stock, cheapest in stock $1.11 at Lium. Nvidia RTX 3060: 1 of 2 providers report stock, cheapest in stock $0.03 at Vast.ai.
What does a month on each card cost?
Nvidia H100: $810 for 730 hours at its cheapest listed rate. Nvidia RTX 3060: $21 for 730 hours at its cheapest listed rate.