Introduction

GigaChat-20B-A3B is the first open MoE model in Russia. In world practice, few people in the world manage to train MoE architectures with good quality. GigaChat is trained mainly in Russian, so unlike the Qwen and LLaMa tunes, it does not make grammar and punctuation errors and does not switch to other languages during a conversation In GigaChat-20B-A3B, cheap inference is combined with good metrics The model is great for research, for example, concentration

Benchmarking

Training

Parameters