স্থাপত্য, শক্তির দিক ও ব্যবহার
Mistral Small 4 119B A6B is an official self-hostable Mistral AI release in the Mistral Generalist Small track. It uses Mistral3ForConditionalGeneration, carries 119B / 6B MoE, supports a verified context window of 1,048,576 টোকেন, and exposes only source-certified checkpoint and runtime combinations. Its release, license and deployment facts are tied to the official repository revision rather than inferred from the family name.
Mistral Small 4 119B A6B uses Mistral3ForConditionalGeneration with 119B / 6B MoE. The stored architecture profile records 36 layers, hidden width 4096, 32 attention heads and a 1,048,576 টোকেন context ceiling where the official configuration publishes those fields.
Verified Mistral3ForConditionalGeneration architecture
1,048,576 টোকেন certified context
Official FP8, NVFP4 checkpoint coverage
Private LLM inference
Agentic workflows
Long-context document processing