>
S
Model Details
Introduction
Benchmarking
FLOPs
1.92e+22Notes: 6 * 1.6B * 2T = 19200000000000000000000
Training
Training Code Accessibility
non-commercial:
https://huggingface.co/stabilityai/stablelm-2-1_6b/blob/main/LICENSEHardware
NVIDIA A100 SXM4 40 GBHardware Quantity
512Size Notes: "model pre-trained on 2 trillion tokens of diverse multilingual and code datasets for two epochs."
Parameters
Parameters
1644417024Notes: Table under Model Architecture gives exact parameter count
Authors
Stability AI Language Team
Image generation