Intel Gaudi2 cloud rental prices

1 providers list the Intel Gaudi2, 1 have it in stock. Prices run from $1.10 to $1.10 per GPU hour — the same card, 1.0x apart.

Gaudi (2nd Gen) 96 GB VRAM Q2 2022 1 configurations

Prices and stock checked 2 hours ago

Cheapest
$1.10
Median
$1.10
across 1 providers
Most expensive
$1.10
same card, 1.0x the price
You overpay by
0%
if you take the median instead of the floor

What it costs you to run

1 hour
$1.10
24 hours
$26.40
1 week
$185
1 month (730h)
$803
1 year
$9,636

Estimated at the cheapest listed rate of $1.10/GPU/hr (Denvr Dataworks), per GPU, before storage, egress or commitment discounts.

Renting at the median instead of the floor costs you an extra $0 a month per GPU. That is 0% of the bill, for identical silicon.

Every provider renting the Intel Gaudi2

Ordered strictly by entry price per GPU hour. Rows above the median are marked. Stock is what the provider reported at our last check, not a guarantee.

Providers renting the Intel Gaudi2, cheapest first
Provider Country Configs Scale From Spot Reserved Stock Grab
Denvr Dataworks United States of America 1 8x-8x $1.10 In stock GrabDenvr Dataworks — opens the provider's site

All 1 configurations

1 of 1 configurations
Intel Gaudi2 configurations from every provider
ConfigurationProviderRegionVRAMvCPURAMBillingPer GPU/hrTotal/hrStock
8x GAUDI2Denvr Dataworkshouston-usa-1768 GB152940 GBOn-Demand$1.10$8.80In stock

What fits in 96 GB

The question behind most rentals: will the model load. Sized against one Intel Gaudi2.

VRAM required to serve open-weight LLMs on a Intel Gaudi2, by quantization precision
Model 16-bit8-bit4-bit
DeepSeek-V3 DeepSeek · 671B params · 37B active 1,610 GB 17× · 22 GB free 805 GB 9× · 59 GB free 403 GB 5× · 77 GB free
Llama 3.1 405B Meta · 405B params 972 GB 11× · 84 GB free 486 GB 6× · 90 GB free 243 GB 3× · 45 GB free
Qwen3 235B-A22B Alibaba · 235B params · 22B active 564 GB 6× · 12 GB free 282 GB 3× · 6 GB free 141 GB 2× · 51 GB free
Mixtral 8x22B Mistral · 141B params · 39B active 338 GB 4× · 46 GB free 169 GB 2× · 23 GB free 85 GB 1× · 11 GB free
Mistral Large 2 Mistral · 123B params 295 GB 4× · 89 GB free 148 GB 2× · 44 GB free 74 GB 1× · 22 GB free
gpt-oss-120b OpenAI · 117B params · 5.1B active 281 GB 3× · 7 GB free 140 GB 2× · 52 GB free 70 GB 1× · 26 GB free
Qwen2.5 72B Alibaba · 72.7B params 174 GB 2× · 18 GB free 87 GB 1× · 9 GB free 44 GB 1× · 52 GB free
Llama 3.3 70B Meta · 70.6B params 169 GB 2× · 23 GB free 85 GB 1× · 11 GB free 42 GB 1× · 54 GB free
Qwen3 32B Alibaba · 32.8B params 79 GB 1× · 17 GB free 39 GB 1× · 57 GB free 20 GB 1× · 76 GB free
Gemma 2 27B Google · 27.2B params 65 GB 1× · 31 GB free 33 GB 1× · 63 GB free 16 GB 1× · 80 GB free
Mistral Small 3 Mistral · 24B params 58 GB 1× · 38 GB free 29 GB 1× · 67 GB free 14 GB 1× · 82 GB free
Llama 3.1 8B Meta · 8B params 19 GB 1× · 77 GB free 10 GB 1× · 86 GB free 5 GB 1× · 91 GB free

Required memory is weights plus 20% for KV cache and runtime at short context; long contexts and large batches need more. Cells tinted green fit on a single Intel Gaudi2.

Intel Gaudi2 specifications

Intel Gaudi2 hardware specifications
ArchitectureGaudi (2nd Gen)
Memory per GPU96 GB HBM2e
Memory bandwidth2,450 GB/s
Release dateQ2 2022
GPU interconnectRoCE 600 GB/s
FP8 compute rate865 TFLOPS (dense)
FP16 / BF16 compute rate432 TFLOPS (dense)
Process nodeTSMC 7nm
Board power600 W

Frequently asked questions

How much does it cost to rent a Intel Gaudi2 per hour?

As of September 6, 2026 the Intel Gaudi2 rents from $1.10 per GPU per hour at Denvr Dataworks. The median across 1 providers is $1.10 and the dearest listing asks $1.10.

Who is the cheapest Intel Gaudi2 provider right now?

Denvr Dataworks at $1.10 per GPU per hour. That is 0% under the median of $1.10, so renting from a mid-priced provider costs you $0.00 an hour more for the same silicon.

What does a Intel Gaudi2 cost per month?

At the cheapest listed rate of $1.10 per GPU per hour, one Intel Gaudi2 running non-stop for a 730-hour month costs $803. At the median rate it costs $803.

Can I actually get a Intel Gaudi2 today?

Yes. 1 of 1 providers reported Intel Gaudi2 stock at the last check. The cheapest one with confirmed stock is Denvr Dataworks at $1.10 per GPU per hour.

How much VRAM does the Intel Gaudi2 have?

96 GB HBM2e per board. That holds a model of roughly 38 billion parameters at 16-bit, or about 76 billion at 8-bit, before context and activations.

What architecture is the Intel Gaudi2, and when did it launch?

Gaudi (2nd Gen), released Q2 2022. 1 cloud providers publish a price for it.

Alternatives to the Intel Gaudi2