Skip to main content

Mistral · Devstral · Devstral 2

Devstral Small 2 24B: Specs, GPU requirements, hosting & deployment

Devstral Small 2 24B is a current Devstral release in the Mistral family, certified from its immutable official source revision.

Technical deployment reference illustration for Devstral Small 2 24B
Reference deployment flow; exact architecture facts are listed separately.
Total parameters24.0B
Active parametersDense model
Context window393,216 tokens
Release statusCurrent · Current
ArchitectureMistral3ForConditionalGeneration
ModalitiesText
LicenseApache License 2.0
Deployment stateDeployable with certified configuration
Commercial stateCommercial Use Allowed
Release date2025-11-28

Architecture, strengths and use cases

Devstral Small 2 24B is an official self-hostable Mistral AI release in the Mistral Devstral track. It uses Mistral3ForConditionalGeneration, carries 24B, supports a verified context window of 393,216 tokens, and exposes only source-certified checkpoints and runtime combinations. Its release, license and deployment facts are tied to the official repository revision rather than inferred from the family name.

Devstral Small 2 24B uses Mistral3ForConditionalGeneration with 24B. The stored architecture profile records 40 layers, hidden width 5120, 32 attention heads and a 393,216 token context ceiling where the official configuration publishes those fields.

Verified Mistral3ForConditionalGeneration architecture
393,216 token certified context
Official FP8 checkpoint coverage
Private LLM inference
Agentic workflows
Long-context document processing
Software engineering and code generation

Certified checkpoints and quantizations

Only exact, source-certified variants attached to this release are shown.

Devstral-Small-2-24B-Instruct-2512

mistralai/Devstral-Small-2-24B-Instruct-2512

Official · FP8 · safetensors

Runtime certified: Transformers vLLM SGLang

Precision / quantizationFormatBitsPublisher trustDeployment state
FP8safetensors8OfficialRuntime certified

Recommended hardware

Use only the listed transformers, vllm, sglang runtime configuration with the exact checkpoint precision. The recommendation engine checks weight memory, KV cache, runtime overhead, safety headroom, GPU architecture and topology before ranking rentable and reference hardware.

Estimated weight memory23.02 GB
KV cache0.63 GB
Runtime overhead8.98 GB
Total with safety margin40.45 GB

Recommended best value

1× NVIDIA H200 SXM 141GB

141 GB total VRAM · nvswitch

100.55 GB headroom · Limited capacity

USD 2,345 / month

Lowest-cost viable

1× NVIDIA H100 PCIe 80GB

80 GB total VRAM · pcie

39.55 GB headroom · Limited capacity

USD 1,579 / month

Highest performance

1× NVIDIA H200 SXM 141GB

141 GB total VRAM · nvswitch

100.55 GB headroom · Limited capacity

USD 2,345 / month

License and self-hosting considerations

The full 24B resident weight set must fit across the selected GPUs. Context and concurrency add KV-cache memory; MoE active parameters do not replace resident-weight memory.

Devstral Small 2 24B is published under Apache License 2.0. The release-scoped official license link and verification date are retained with the catalogue record.

Commercial Use Allowed. The official license permits commercial use; its obligations still apply.

Alternatives and sibling variants

Devstral 2 123B Instruct 2512

Release timeline

mistral-ai/mistral/devstral-small-2-24b @ 3c894e9887e10a0e048cf6875d183a2387181ad333678430fdd8e5ab537b889c

Official source

Frequently asked questions

How much VRAM does Devstral Small 2 24B require?

The exact estimate depends on checkpoint precision, context and concurrency; the page recommendation uses the certified memory engine and compatible runtime configurations.

Which runtimes support Devstral Small 2 24B?

Certified upstream runtime evidence is available for transformers, vllm, sglang.

Can Devstral Small 2 24B be used commercially?

The stored commercial classification is Commercial Use Allowed. Consult the official Apache License 2.0 terms for the final obligations.

Official references

Last verified: 2026-08-26