Architecture, strengths and use cases
ERNIE 4.5 21B-A3B Thinking is an official self-hostable Baidu release in the ERNIE Reasoning track. It uses Ernie4_5_MoeForCausalLM, carries 21B / 3B MoE, supports a verified context window of 131,072 tokens, and exposes only source-certified checkpoints and runtime combinations. Its release, license and deployment facts are tied to the official repository revision rather than inferred from the family name.
ERNIE 4.5 21B-A3B Thinking uses Ernie4_5_MoeForCausalLM with 21B / 3B MoE. The stored architecture profile records 28 layers, hidden width 2560, 20 attention heads and a 131,072 token context ceiling where the official configuration publishes those fields.
Verified Ernie4_5_MoeForCausalLM architecture
131,072 token certified context
Official BF16, Unknown checkpoint coverage
Private LLM inference
Agentic workflows
Long-context document processing