Model Details

Domain:

Task:

Quantitative reasoning

Model Access:

Open weights (unrestricted)

AI Tools Usage

This model is commonly used behind the scenes in AI tools.

Introduction

In the past three months since Qwen2’s release, numerous developers have built new models on the Qwen2 language models, providing us with valuable feedback. During this period, we have focused on creating smarter and more knowledgeable language models. Today, we are excited to introduce the latest addition to the Qwen family: Qwen2.5. We are announcing what might be the largest opensource release in history! Let’s get the party started!

Benchmarking

FLOPs7.8e+24

Notes: Training dataset size was 18 trillion 6ND = 6 * 72.7 billion parameters * 18 trillion tokens = 7.8e24

Training

Training Code Accessibilitylicense: allows commercial. weights only https://huggingface.co/Qwen/Qwen2.5-72B/blob/main/LICENSE

Size Notes: "In terms of Qwen2.5, the language models, all models are pretrained on our latest large-scale dataset, encompassing up to 18 trillion tokens"