>
A
Model Details
Domain:
Model Access:
Open weights (unrestricted)
Introduction
Researchers at EPFL, ETH Zurich and CSCS have developed Apertus, a fully open Large Language Model (LLM) – one of the largest of its kind. As a foundational technology, Apertus enables innovation and strengthens AI expertise across research, society and industry by allowing others to build upon it. Apertus is currently available through strategic partner Swisscom, the AI platform Hugging Face, and the Public AI network.
Benchmarking
Notes: 6 FLOP / parameter / token * 8 * 10^9 parameters * 15 * 10^12 tokens = 7.2e+23 FLOP
Training
Training Code AccessibilityApache 2.0 https://huggingface.co/swiss-ai/Apertus-70B-Instruct-2509 Apache 2.0 https://github.com/swiss-ai/pretrain-code
HardwareNVIDIA GH200
Hardware Quantity4096
Size Notes: "Trained on 15 trillion tokens across more than 1,000 languages – 40% of the data is non-English"
Parameters
Parameters8000000000
Notes: 8B