Compare GPUs
Compare 2-4 public GPU options using the same database-backed price, inventory and specification records.
| GPU |
NVIDIA H200 SXM 141GB |
NVIDIA H100 SXM 80GB |
|---|---|---|
| Monthly rental | USD 2,345/month | USD 1,860/month |
| Hourly equivalent | ~ USD 3.21/hour | ~ USD 2.55/hour |
| VRAM | 141 GB HBM3e | 80 GB HBM3 |
| Architecture | Hopper | Hopper |
| Bandwidth | 4,800 GB/s | 3,350 GB/s |
| Form factor | SXM module | SXM module |
| Interface | PCIe Gen5 x16 host interface | PCIe Gen5 x16 host interface |
| TDP | 700 W | 700 W |
| FP32 | 67 TFLOPS dense | 67 TFLOPS dense |
| TF32 | 494.5 TFLOPS dense / 989 TFLOPS sparse | 494.5 TFLOPS dense / 989 TFLOPS sparse |
| BF16 | 989.5 TFLOPS dense / 1979 TFLOPS sparse | 989.5 TFLOPS dense / 1979 TFLOPS sparse |
| FP16 | 989.5 TFLOPS dense / 1979 TFLOPS sparse | 989.5 TFLOPS dense / 1979 TFLOPS sparse |
| FP8 | 1979 TFLOPS dense / 3958 TFLOPS sparse | 1979 TFLOPS dense / 3958 TFLOPS sparse |
| INT8 | 1979 TOPS dense / 3958 TOPS sparse | 1979 TOPS dense / 3958 TOPS sparse |
| MIG | Up to 7 MIGs @ 18 GB | Up to 7 MIGs @ 10 GB |
| NVLink | 900 GB/s NVLink | 900 GB/s NVLink |
| Availability | Limited availability | Available |
| Frameworks | PyTorch, TensorFlow, JAX, Hugging Face, vLLM, TensorRT, ONNX Runtime, CUDA | PyTorch, TensorFlow, JAX, Hugging Face, vLLM, TensorRT, ONNX Runtime, CUDA |
| Model compatibility guidance | Recommended for quantised inference; review context and concurrency | Recommended for quantised inference; review context and concurrency |
| Action | Configure & rent | Configure & rent |