Mistral / Mistral Small 4 119B A6B
NVFP4 quantization for Mistral Small 4 119B A6B
The published profile is indicative; engineering measurements are completed for the selected model and hardware.
Before → After
Base releaseVerified checkpoint
119.000B
119.000B
QuantizationNVFP4
Quality retention target
Quality retention target
Production artifactArtifact
Lineage and benchmark report
Lineage and benchmark report
GPU targeting
Weights and KV cacheEstimated until measured during engineering
Estimated VRAMMeasured and certified results are delivered with the project.
Runtime packagingtransformers, vllm, sglang
Transparent pricing
Not currently orderable