Skip to main content

NVIDIA Nemotron · Omni · Nemotron 3 Nano Omni

NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8: Specs, GPU requirements, hosting & deployment

NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8 is a current Omni release in the NVIDIA Nemotron family, certified from its immutable official source revision.

Technical deployment reference illustration for NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8
Reference deployment flow; exact architecture facts are listed separately.
Total parameters31.0B
Active parameters3.0B
Context window262,144 tokens
Release statusCurrent · Current
ArchitectureNemotronH_Nano_Omni_Reasoning_V3
ModalitiesText, Image, Audio, Video
LicenseNVIDIA Open Model Agreement
Deployment stateDeployable with certified configuration
Commercial stateCommercial Use Allowed With Conditions
Release date2026-04-24

Architecture, strengths and use cases

NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8 is an official self-hostable NVIDIA release in the NVIDIA Nemotron Omni track. It uses NemotronH_Nano_Omni_Reasoning_V3, carries 31B / 3B MoE, supports a verified context window of 262,144 tokens, and exposes only source-certified checkpoints and runtime combinations. Its release, license and deployment facts are tied to the official repository revision rather than inferred from the family name.

NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8 uses NemotronH_Nano_Omni_Reasoning_V3 with 31B / 3B MoE. The stored architecture profile records 64 layers, hidden width 8192, 64 attention heads and a 262,144 token context ceiling where the official configuration publishes those fields.

Verified NemotronH_Nano_Omni_Reasoning_V3 architecture
262,144 token certified context
Official FP8, Unknown checkpoint coverage
Private LLM inference
Agentic workflows
Long-context document processing
Vision-language analysis
Audio understanding

Certified checkpoints and quantizations

Only exact, source-certified variants attached to this release are shown.

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8

nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-FP8

Official · FP8 · safetensors

Runtime certified: vLLM SGLang TensorRT-LLM Llama.cpp

Precision / quantizationFormatBitsPublisher trustDeployment state
FP8safetensors8OfficialRuntime certified

Recommended hardware

Use only the listed vllm, sglang, tensorrt-llm, llama.cpp runtime configuration with the exact checkpoint precision. The recommendation engine checks weight memory, KV cache, runtime overhead, safety headroom, GPU architecture and topology before ranking rentable and reference hardware.

Estimated weight memory29.74 GB
KV cache1 GB
Runtime overhead10.25 GB
Total with safety margin50.83 GB

Recommended best value

1× NVIDIA H200 SXM 141GB

141 GB total VRAM · nvswitch

90.17 GB headroom · Limited capacity

USD 2,345 / month

Lowest-cost viable

3× NVIDIA L4 24GB

72 GB total VRAM · pcie

21.17 GB headroom · Available

USD 750 / month

Highest performance

1× NVIDIA H200 SXM 141GB

141 GB total VRAM · nvswitch

90.17 GB headroom · Limited capacity

USD 2,345 / month

License and self-hosting considerations

The full 31B resident weight set must fit across the selected GPUs. Context and concurrency add KV-cache memory; MoE active parameters do not replace resident-weight memory.

NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8 is published under NVIDIA Open Model Agreement. The release-scoped official license link and verification date are retained with the catalogue record.

Commercial Use Allowed With Conditions. Commercial use is conditional. Review the linked official terms before deployment.

Release timeline

nvidia/nemotron/nemotron-3-nano-omni-30b-a3b-reasoning-fp8

Source details

Official source

Source revision: dd885e9548478d0d433c1239ed4598ad4a9faf7f58a8c706ab89885e5e2117fa

Frequently asked questions

How much VRAM does NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8 require?

The exact estimate depends on checkpoint precision, context and concurrency; the page recommendation uses the certified memory engine and compatible runtime configurations.

Which runtimes support NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8?

Certified upstream runtime evidence is available for vllm, sglang, tensorrt-llm, llama.cpp.

Can NVIDIA Nemotron 3 Nano Omni 30B-A3B Reasoning FP8 be used commercially?

The stored commercial classification is Commercial Use Allowed With Conditions. Consult the official NVIDIA Open Model Agreement terms for the final obligations.

Official references

Last verified: 2026-08-26