Skip to main content

Gemma · General · Gemma 3

Gemma 3 12B IT: Specs, GPU requirements, hosting & deployment

Gemma 3 12B IT is a recent General release in the Gemma family, certified from its immutable official source revision.

Technical deployment reference illustration for Gemma 3 12B IT
Reference deployment flow; exact architecture facts are listed separately.
Total parameters12.0B
Active parametersDense model
Context window128,000 tokens
Release statusRecent · Recent
ArchitectureDense Transformer
ModalitiesText, Image
LicenseGemma Terms of Use
Deployment stateDeployable with certified configuration
Commercial stateCommercial Use Allowed With Conditions
Release date2025-03-01

Architecture, strengths and use cases

Gemma 3 12B IT is an official self-hostable Google release in the Gemma General track. It uses Dense Transformer, carries 12B, supports a verified context window of 128,000 tokens, and exposes only source-certified checkpoints and runtime combinations. Its release, license and deployment facts are tied to the official repository revision rather than inferred from the family name.

Gemma 3 12B IT uses Dense Transformer with 12B. The stored architecture profile records 64 layers, hidden width 8192, 64 attention heads and a 128,000 token context ceiling where the official configuration publishes those fields.

Verified Dense Transformer architecture
128,000 token certified context
Official BF16, Unknown checkpoint coverage
Private LLM inference
Agentic workflows
Long-context document processing
Vision-language analysis

Certified checkpoints and quantizations

Only exact, source-certified variants attached to this release are shown.

gemma-3-12b-it

google/gemma-3-12b-it

Official · BF16 · safetensors

Runtime certified: Transformers

Precision / quantizationFormatBitsPublisher trustDeployment state
BF16safetensors16OfficialRuntime certified

Recommended hardware

Use only the listed transformers runtime configuration with the exact checkpoint precision. The recommendation engine checks weight memory, KV cache, runtime overhead, safety headroom, GPU architecture and topology before ranking rentable and reference hardware.

Estimated weight memory23.02 GB
KV cache2 GB
Runtime overhead9.22 GB
Total with safety margin42.47 GB

Recommended best value

1× NVIDIA H200 SXM 141GB

141 GB total VRAM · nvswitch

98.53 GB headroom · Limited capacity

USD 2,345 / month

Lowest-cost viable

2× NVIDIA L4 24GB

48 GB total VRAM · pcie

5.53 GB headroom · Available

USD 500 / month

Highest performance

1× NVIDIA H200 SXM 141GB

141 GB total VRAM · nvswitch

98.53 GB headroom · Limited capacity

USD 2,345 / month

License and self-hosting considerations

The full 12B resident weight set must fit across the selected GPUs. Context and concurrency add KV-cache memory; MoE active parameters do not replace resident-weight memory.

Gemma 3 12B IT is published under Gemma Terms of Use. The release-scoped official license link and verification date are retained with the catalogue record.

Commercial Use Allowed With Conditions. Commercial use is conditional. Review the linked official terms before deployment.

Alternatives and sibling variants

Gemma 3 27B IT, Gemma 4 12B IT, Gemma 4 31B IT, Gemma 4 26B-A4B IT

Release timeline

google/gemma/gemma-3-12b-it

Source details

Official source

Source revision: 4f0c195eeedeb238fd660bbc25f073a1b0fb4f1d8adb8d2f8103e12cb2defc46

Frequently asked questions

How much VRAM does Gemma 3 12B IT require?

The exact estimate depends on checkpoint precision, context and concurrency; the page recommendation uses the certified memory engine and compatible runtime configurations.

Which runtimes support Gemma 3 12B IT?

Certified upstream runtime evidence is available for transformers.

Can Gemma 3 12B IT be used commercially?

The stored commercial classification is Commercial Use Allowed With Conditions. Consult the official Gemma Terms of Use terms for the final obligations.

Official references

Last verified: 2026-08-26