Today, we’re introducing Jamba 1.6, the best open model family on the market for enterprise deployment, offering: Leading open model quality: Jamba Large 1.6 outperforms Mistral Large 2, Llama 3.3 70B, and Command R+ on quality, and Jamba Mini 1.6 outperforms Ministral 8B, Llama 3.1 8B, and Command R7B. Unparalleled long context performance: With a context window of 256K and hybrid SSM-Transformer architecture, Jamba 1.6 excels at RAG and long context grounded question answering tasks. Flexible deployment: In addition to AI21 Studio, the models are available to download from Hugging Face and deploy privately on-prem or in-VPC, with more deployment options coming soon.
Training Code AccessibilityJamba Open Model License Agreement ($50M in annual revenue cap for commercial use): https://huggingface.co/ai21labs/AI21-Jamba-Large-1.6
Parameters398000000000
Notes: 94B active/398B total