ibm/granite/granite-41-30b-gguf
Source details
Source revision: a4a42312a56a3dff29f67d89361b375e5f1efa375fc7607cc1417ea127727e3c
IBM · Text
IBM Granite models: Versions, specs, GPU requirements & hosting
IBM Granite provides enterprise-focused language checkpoints across compact and larger deployment sizes with permissive release-level licensing.
Overview and history
IBM Granite is an official IBM model family represented here through independently verified release, checkpoint, license, runtime and hardware evidence. IBM Granite provides enterprise-focused language checkpoints across compact and larger deployment sizes with permissive release-level licensing. Current public releases are grouped by the General tracks so sibling sizes and specialist branches are not presented as false chronological generations.
FusionPointAI currently tracks 12 certified public IBM Granite releases. The catalogue preserves release dates and evaluates Current, Recent, Previous and Legacy status within each model track rather than by database insertion order.
Enterprise deployment focus
Multiple model sizes
Broad runtime support
Architecture and model range
The verified public range spans 3B to 30B total parameters and context windows up to 131,072 tokens. Each release states whether it is dense or mixture-of-experts and records active parameters separately when the official source publishes them.
Public releases12
Model tracks1
Current generationGranite 4.2 30B
Last verified2026-09-03T00:00:00.000000Z
Generations, tracks and variants
General
Granite 3.3
Previous generationgranite-4-2-3b
Recent generation 5 sibling variantsgranite-4.2-3b
The manufacturer has not published this information. parameters · N/A / Not directly comparable context
Base
granite-4.2-3b-fp8
The manufacturer has not published this information. parameters · N/A / Not directly comparable context
Quantization
granite-4.2-3b-nvfp4
The manufacturer has not published this information. parameters · N/A / Not directly comparable context
Quantization
granite-4.2-3b-mxfp4
The manufacturer has not published this information. parameters · N/A / Not directly comparable context
Quantization
granite-4.2-3b-GGUF
The manufacturer has not published this information. parameters · N/A / Not directly comparable context
Quantization
Granite 4.1
Recent generationgranite-4-1-30b
Recent generation 2 sibling variantsGranite 4.2
Current generation 3 sibling variantsDeployment ecosystem
Choose a specific IBM Granite release and certified checkpoint before sizing hardware. FusionPointAI rejects unknown runtime configurations, calculates resident memory from total model weights, then distinguishes globally compatible GPUs from currently rentable inventory.
Validate the exact checkpoint license, runtime version, precision kernel, context length, concurrency and multi-GPU topology. Active MoE parameters affect compute, but resident model memory continues to use total stored weights.
Common use cases
Business assistants
Document processing
Private inference
License overview
Licenses are certified per release, not inferred from the provider. Review the release page before commercial deployment because terms can differ between generations and variants.
Commercial-use status is a source-backed catalogue classification, not legal advice. Follow the linked official license and attribution requirements.
Release timeline
ibm/granite/granite-41-30b-fp8
Source details
Source revision: 2006d06729657c5b131fc9971f6d5dabf272bdbd3293c646dd4e134414edaeae
ibm/granite/granite-4-1-30b
Source details
Source revision: c9d5fa2930a611bb481573dc233b242ee8f2b45f60d32c68ce6bb1bd80e1be0c
ibm/granite/granite-42-3b-gguf
Source details
Source revision: 83f847c71f7e86c289128785baf06d0ec25033683ea92012d230707afbb6f01e
ibm/granite/granite-42-3b-nvfp4
Source details
Source revision: e9aa554262fef214b1a003c3a759526ab710f48e3517b08308a9e64bc67e557a
ibm/granite/granite-42-3b-mxfp4
Source details
Source revision: d523d0dbb104704c5418a46a1b77d8586f5dd7e866b607c11584366178f689fc
ibm/granite/granite-42-3b-fp8
Source details
Source revision: 6f3e2b6caad002f9daf7726d085987d8a97d1993216336c9dddc7fbe8f642b7f
ibm/granite/granite-3-3-8b
Source details
Source revision: 180c386c903c1543d8c3c4f94e27491c4b6cb66fbece18abcbd198d01e320468
ibm/granite/granite-4-2-30b
Source details
Source revision: 37162f41301604396463c91856e5c7bdfaf69aaab7a36920fee97fedd14fa694
ibm/granite/granite-4-2-8b
Source details
Source revision: cab33b9e1d79489645311c751bc727a0c725f637793648e9c33bcccf04de3b78
ibm/granite/granite-4-2-3b
Source details
Source revision: dd9a1fe61833ecf5e9963237b60da9469bf3d5cf750bd93cde2c2997bb74da98
ibm/granite/granite-42-3b
Source details
Source revision: e01442b49f274eabb1750952a68ef40b032c48a6bff7dc8d1120c4ba80881aa1
ibm-granite/granite-4.2-3b @ 2026-08-25T18:42:47Z
Frequently asked questions
Which IBM Granite release is current?
Current releases are Granite 4.2 30B, Granite 4.2 8B, Granite 4.2 3B, evaluated within their respective tracks.
Can IBM Granite be self-hosted?
Only releases with a verified official checkpoint and supported runtime configuration are presented as deployable.
Which GPU should run IBM Granite?
GPU selection depends on the exact variant, checkpoint precision, context length and concurrency; use the release hardware recommendations rather than the family name alone.
Official references
- huggingface.co
- huggingface.co
- huggingface.co
- huggingface.co
- huggingface.co
- modelscope.cn
- huggingface.co
- huggingface.co
- huggingface.co
- huggingface.co
- huggingface.co
- huggingface.co
Last verified: 2026-09-03