NVIDIA H100 vs H200
Compare published specifications with current rental availability.
Differences are derived only from verified memory, bandwidth, power, form factor, precision support, software ecosystem and real inventory.
| Field | NVIDIA H100 SXM 80GB | NVIDIA H200 SXM 141GB |
|---|---|---|
| Vendor | NVIDIA | NVIDIA |
| Exact SKU | H100 SXM | H200 SXM |
| Architecture | Hopper | Hopper |
| Generation | Hopper | Hopper |
| Category | Data center | Data center |
| Lifecycle | Current | Current |
| VRAM | 80 GB | 141 GB |
| Memory technology | HBM3 | HBM3e |
| Bandwidth | 3,350 GB/s | 4,800 GB/s |
| Power | 700 W | 700 W |
| Interface | PCIe Gen5 host interface | PCIe Gen5 host interface |
| Form factor | SXM · Module | SXM · Module |
| Interconnect | NVLink | NVLink |
| MIG / partitioning | Supported | Supported |
| Numeric precision formats | FP64, FP32, TF32, BF16, FP16, FP8, INT8 | FP64, FP32, TF32, BF16, FP16, FP8, INT8 |
| Runtime ecosystem | cuda, vllm, sglang, tensorrt-llm | cuda, vllm, sglang, tensorrt-llm |
| Rental availability | Available | Limited capacity |
| Monthly rental price | USD 1,860 | USD 2,345 |
Verified differences
- NVIDIA H200 SXM 141GB has the most VRAM in this selection.
- NVIDIA H200 SXM 141GB has the highest recorded memory bandwidth.
Architecture differences
Source-verified facts: NVIDIA H100 SXM 80GB: Hopper / Hopper / SXM · Module · NVIDIA H200 SXM 141GB: Hopper / Hopper / SXM · Module
VRAM and memory requirements
Source-verified facts: NVIDIA H100 SXM 80GB: 80 GB / HBM3 / 3,350 GB/s · NVIDIA H200 SXM 141GB: 141 GB / HBM3e / 4,800 GB/s
Power and cooling
Source-verified facts: NVIDIA H100 SXM 80GB: 700 W / SXM · Module · NVIDIA H200 SXM 141GB: 700 W / SXM · Module
AI precision support
Source-verified facts: NVIDIA H100 SXM 80GB: FP64, FP32, TF32, BF16, FP16, FP8, INT8 · NVIDIA H200 SXM 141GB: FP64, FP32, TF32, BF16, FP16, FP8, INT8
Interface and interconnect
Source-verified facts: NVIDIA H100 SXM 80GB: PCIe Gen5 host interface / NVLink · NVIDIA H200 SXM 141GB: PCIe Gen5 host interface / NVLink
Multi-GPU considerations
Large variants may require tensor parallelism or multiple nodes. Validate total resident weights, runtime support, interconnect, topology and headroom before choosing a GPU count.
Model and workload fit
Model fit depends on exact checkpoint precision, runtime support, memory headroom and topology. Reference compatibility does not imply FusionPointAI rental inventory.
Rental availability
Source-verified facts: NVIDIA H100 SXM 80GB: Available / USD 1,860 / month · NVIDIA H200 SXM 141GB: Limited capacity / USD 2,345 / month
Official sources
Last verified: 2026-08-25