What does an H200 NVL server cost by card count, and which servers take the card?
The H200 NVL is the Hopper datacenter GPU as a dual slot PCIe Gen5 card with 141 GB of HBM3e memory at 4.8 TB/s, bridged two or four ways over NVLink. It goes in standard air cooled 4U and 5U servers in place of an HGX baseboard, from two cards to ten. The card is posted at three quantity tiers and sold from four units. Every server on our menu that takes it is listed below, priced per system at the card count shown.
The card
| H200 NVL | |
|---|---|
| GPU architecture | Hopper |
| Memory | 141 GB HBM3e |
| Memory bandwidth | 4.8 TB/s |
| Form factor | PCIe Gen5, dual slot |
| Interconnect | NVLink bridge, 2 or 4 way |
| Max power | 600 W |
| Sold from | 4 cards |
| Price, tier 1 | $34,500 per card, 4 to 7 |
| Price, tier 2 | $33,750 per card, 8 to 19 |
| Price, tier 3 | $33,000 per card, 20 to 49 |
| Today | Available now |
Specifications as NVIDIA publishes them; the posted price is per card at the quantity tier. Contact us for volume pricing.
H200 NVL servers by card count, priced per system
Every option is priced. The configured price is per system at the quantity band and is invoiced at checkout. A configured row is priced at the two to four system band with the default processor, memory, storage and network picks; the pre-built row is a fixed configuration at one price.
How the cards are bridged
A four way NVLink bridge joins four cards into one 564 GB memory domain at 900 GB/s per GPU. Eight cards are bridged as two groups of four, and two cards take a two way bridge.
How the server price is set
A configured row is priced at the two to four system band with the server's default processor, memory, storage and network picks and the H200 NVL count shown. The pre-built AS-5126GS-TNRT carries five cards in a fixed configuration at one price. A row marked Available checks out at the price shown, with payment at order, and ships in the band printed beside it. The ASUS server and the 4 and 8 GPU servers built by other integrators are quoted to configuration.
Questions
What does a four card H200 NVL server cost?
From $145,100 per system at two to four systems, on a Supermicro 4U or 5U server with the default picks. An eight card system starts at $272,400. The price moves with the processor, memory and storage chosen on the server's page.
Is the H200 NVL the same GPU as the H200 SXM?
The same Hopper GPU and the same 141 GB of HBM3e. The NVL is a PCIe card for standard servers, bridged two or four ways, where the SXM module sits on an HGX baseboard of eight with NVLink across all eight.
How many H200 NVL cards fit in one server?
Two, four or eight in the 4U and 5U Supermicro servers, ten in the AS-5126GS-TNRT2, and five in the pre-built AS-5126GS-TNRT.
Can I buy the cards on their own?
Yes, from four cards at the posted tiers, from the card's own page. Above the quantity we hold, the cart shows the balance as backordered at 7 to 14 days before you pay.
Where to go next
Accelerators, systems and racks, bare GPU servers, interconnect, cooling and power, what is available today, the RTX PRO 6000 editions, H200 NVL servers by card count, how ordering works, terms.