AMD MI355X vs NVIDIA H200
Compare published specifications with current rental availability.
Differences are derived only from verified memory, bandwidth, power, form factor, precision support, software ecosystem and real inventory.
| Field | AMD Instinct MI355X 288GB | NVIDIA H200 SXM 141GB |
|---|---|---|
| Vendor | AMD | NVIDIA |
| Exact SKU | MI355X | H200 SXM |
| Architecture | CDNA 4 | Hopper |
| Generation | Instinct | Hopper |
| Category | Data center | Data center |
| Lifecycle | Current | Current |
| VRAM | 288 GB | 141 GB |
| Memory technology | HBM3E | HBM3e |
| Bandwidth | 8,000 GB/s | 4,800 GB/s |
| Power | 1400 W | 700 W |
| Interface | AMD platform interface | PCIe Gen5 host interface |
| Form factor | AMD · Accelerator · Module | SXM · Module |
| Interconnect | Infinity Fabric | NVLink |
| MIG / partitioning | Not listed as supported | Supported |
| Numeric precision formats | FP64, FP32, BF16, FP16, FP8, FP6, FP4, INT8 | FP64, FP32, TF32, BF16, FP16, FP8, INT8 |
| Runtime ecosystem | rocm, vllm | cuda, vllm, sglang, tensorrt-llm |
| Rental availability | Reference only | Limited capacity |
| Monthly rental price | Reference only | USD 2,345 |
Verified differences
- AMD Instinct MI355X 288GB has the most VRAM in this selection.
- AMD Instinct MI355X 288GB has the highest recorded memory bandwidth.
- NVIDIA H200 SXM 141GB has the lowest published power value.
Architecture differences
Source-verified facts: AMD Instinct MI355X 288GB: CDNA 4 / Instinct / AMD · Accelerator · Module · NVIDIA H200 SXM 141GB: Hopper / Hopper / SXM · Module
VRAM and memory requirements
Source-verified facts: AMD Instinct MI355X 288GB: 288 GB / HBM3E / 8,000 GB/s · NVIDIA H200 SXM 141GB: 141 GB / HBM3e / 4,800 GB/s
Power and cooling
Source-verified facts: AMD Instinct MI355X 288GB: 1400 W / AMD · Accelerator · Module · NVIDIA H200 SXM 141GB: 700 W / SXM · Module
AI precision support
Source-verified facts: AMD Instinct MI355X 288GB: FP64, FP32, BF16, FP16, FP8, FP6, FP4, INT8 · NVIDIA H200 SXM 141GB: FP64, FP32, TF32, BF16, FP16, FP8, INT8
Interface and interconnect
Source-verified facts: AMD Instinct MI355X 288GB: AMD platform interface / Infinity Fabric · NVIDIA H200 SXM 141GB: PCIe Gen5 host interface / NVLink
Multi-GPU considerations
Large variants may require tensor parallelism or multiple nodes. Validate total resident weights, runtime support, interconnect, topology and headroom before choosing a GPU count.
Model and workload fit
Model fit depends on exact checkpoint precision, runtime support, memory headroom and topology. Reference compatibility does not imply FusionPointAI rental inventory.
Rental availability
Source-verified facts: AMD Instinct MI355X 288GB: Reference only · NVIDIA H200 SXM 141GB: Limited capacity / USD 2,345 / month
Official sources
Last verified: 2026-08-25