AMD · Data center · OAM module
AMD Instinct MI350X 288GB
Exact MI350X reference specifications and AI deployment guidance, separated from FusionPointAI commercial inventory.
Current
Reference only
Verified technical specifications
| Manufacturer | AMD |
|---|---|
| Exact SKU | MI350X |
| Product family | AMD MI350X |
| Architecture | CDNA 4 |
| Generation | Instinct |
| Entity type | OAM module |
| Lifecycle | Current |
| Launch date | The manufacturer has not published this information. |
| VRAM | 288 GB |
| Memory technology | HBM3E |
| Memory bandwidth | 8,000 GB/s |
| Power | 1000 W |
| Interface | AMD platform interface |
| Form factor | AMD · Accelerator · Module |
| Interconnect | Infinity Fabric |
| MIG / partitioning | Not supported |
| Supported numeric formats | FP64, FP32, BF16, FP16, FP8, FP6, FP4, INT8 |
| Software stack | rocm, vllm |
AI workload suitability
LLM inference
High memory capacity supports large checkpoints and multi-GPU inference when runtime and topology are certified.
Fine-tuning and training
Designed for sustained accelerator workloads; training suitability depends on interconnect, precision and cluster topology.
Image, video and embeddings
FP16 acceleration supports common generative and vector workloads within the listed VRAM envelope.
Power and cooling
1000 W published power requires chassis, airflow and power delivery for this exact form factor.
Multi-GPU use
Infinity Fabric is the recorded interconnect path; topology must still be validated at node level.
Software ecosystem
rocm, vllm
Product timeline
Media gallery
Official manufacturer source
https://www.amd.com/en/products/specifications/accelerators.html
Last verified: 2026-08-24