Everything on Model Architecture

Mistrall introduces a sparse Mixture of Experts architecture that consolidates specialized capabilities—coding, reasoning, and instruction following—into a single model with only 6 billion active parameters and a 256K context window.

Impact: Reduces inference costs and hardware requirements while maintaining performance, allowing businesses to deploy advanced AI solutions on more accessible infrastructure.

— from Mistral AI Unveils Voxtral TTS, Mistrall MoE, and Lean Reasoning · Latent Space: The AI Engineer Podcast· Mar 30, 2026