Skip to main content

IBM Granite · General · granite-4-2-3b

granite-4.2-3b-fp8: Specs, GPU requirements, hosting & deployment

granite-4.2-3b-fp8 is a recent General release in the IBM Granite family, certified from its immutable official source revision.

Reference only Compare this model
Technical deployment reference illustration for granite-4.2-3b-fp8
Reference deployment flow; exact architecture facts are listed separately.
Total parametersNot published by manufacturer
Active parametersDense model
Context windowN/A / Not directly comparable
Release statusRecent · Recent
Architecture
ModalitiesText
Licenseapache-2.0
Deployment stateReference only
Commercial stateCommercial Use Allowed
Release date

Architecture, strengths and use cases

granite-4.2-3b-fp8 is an official self-hostable IBM release in the IBM Granite General track. It uses Not published by manufacturer, carries Not published by manufacturer, supports a verified context window of 0 tokens, and exposes only source-certified checkpoints and runtime combinations. Its release, license and deployment facts are tied to the official repository revision rather than inferred from the family name.

granite-4.2-3b-fp8 uses Not published by manufacturer with Not published by manufacturer. The stored architecture profile records layers, hidden width , attention heads and a 0 token context ceiling where the official configuration publishes those fields.

Verified Not published by manufacturer architecture
Official checkpoint and pipeline evidence
Official FP8 checkpoint coverage
Private LLM inference
Agentic workflows
Long-context document processing

Certified checkpoints and quantizations

Only exact, source-certified variants attached to this release are shown.

Recommended hardware

Use only the listed certified runtime configuration with the exact checkpoint precision. The recommendation engine checks weight memory, KV cache, runtime overhead, safety headroom, GPU architecture and topology before ranking rentable and reference hardware.

Reference only

The official license permits commercial use; its obligations still apply.

License and self-hosting considerations

The full 0B resident weight set must fit across the selected GPUs. Context and concurrency add KV-cache memory; MoE active parameters do not replace resident-weight memory.

granite-4.2-3b-fp8 is published under apache-2.0. The release-scoped official license link and verification date are retained with the catalogue record.

Commercial Use Allowed. The official license permits commercial use; its obligations still apply.

Alternatives and sibling variants

granite-4.2-3b, granite-4.2-3b-GGUF, granite-4.2-3b-nvfp4, granite-4.2-3b-mxfp4, granite-4.1-30b-fp8, granite-4.1-30b-GGUF, Granite 4.2 30B, Granite 4.2 8B, Granite 4.2 3B

Release timeline

ibm/granite/granite-42-3b-fp8 @ 6f3e2b6caad002f9daf7726d085987d8a97d1993216336c9dddc7fbe8f642b7f

Official source

Frequently asked questions

How much VRAM does granite-4.2-3b-fp8 require?

The exact estimate depends on checkpoint precision, context and concurrency; the page recommendation uses the certified memory engine and compatible runtime configurations.

Which runtimes support granite-4.2-3b-fp8?

No runtime is presented as supported until upstream evidence is verified.

Can granite-4.2-3b-fp8 be used commercially?

The stored commercial classification is Commercial Use Allowed. Consult the official apache-2.0 terms for the final obligations.

Official references

Last verified: 2026-09-03