AI Compute
Board finder
Memory needed for a model at a chosen precision, and the eight GPU boards that hold it, each at its posted from-price.
Memory needed
Memory needed 396 GB. 8 of 8 boards fit in memory.
- Weights
- 140 GB
- Reserve
- 256 GB
Memory needed is weights plus the reserve. Weights are parameters times bytes per parameter; the reserve covers the KV cache and the runtime.
| Board | Total memory | Per GPU | Memory fit | Headroom | From price | Board page |
|---|---|---|---|---|---|---|
| NVIDIAHGX H100 8 GPU board935-24287-0001-000 | 640 GB | 80 GB | Fits | 244 GB | $192,500per board | See the board for the HGX H100 8 GPU board |
| IntelGaudi 3 8 OAM boardHL-325L | 1,024 GB | 128 GB | Fits | 628 GB | $137,500per board | See the board for the Gaudi 3 8 OAM board |
| NVIDIAHGX H200 8 GPU board935-24287-0041-000 | 1,128 GB | 141 GB | Fits | 732 GB | $242,000per board | See the board for the HGX H200 8 GPU board |
| NVIDIAHGX B200 8 GPU board935-26287-00A0-0R0 | 1,440 GB | 180 GB | Fits | 1,044 GB | $269,500per board | See the board for the HGX B200 8 GPU board |
| AMDMI300X 8 OAM board | 1,536 GB | 192 GB | Fits | 1,140 GB | $217,250per board | See the board for the MI300X 8 OAM board |
| AMDMI325X 8 OAM board100-300000108H | 2,048 GB | 256 GB | Fits | 1,652 GB | $316,800per board | See the board for the MI325X 8 OAM board |
| NVIDIAHGX B300 8 GPU board935-26287-0070-000 | 2,160 GB | 270 GB | Fits | 1,764 GB | $434,500per board | See the board for the HGX B300 8 GPU board |
| AMDMI355X 8 OAM board100-300000254H | 2,304 GB | 288 GB | Fits | 1,908 GB | $341,000per board | See the board for the MI355X 8 OAM board |