>
Y
Model Details
Domain:
Model Access:
Open weights (restricted use)
Citations:
7
Introduction
In this technical report, we propose YAYI 2, including both base and chat models, with 30 billion parameters. YAYI 2 is pre-trained from scratch on a multilingual corpus which contains 2.65 trillion tokens filtered by our pre-training data processing pipeline.
Benchmarking
FLOPs
4.77e+23Notes: 1000 A800 GPUs
Training
Training Code Accessibility
unclear license
https://huggingface.co/wenge-research/yayi2-30b
this license file https://github.com/wenge-research/YAYI2/blob/main/COMMERCIAL_LICENSE
prohibits particular usage (i.e. military, direct competitors)
To use YAYI2 models commercially, you must apply for a commercial license.
apache 2.0 for codeHardware
NVIDIA A800 PCIe 40 GBHardware Quantity
1000Parameters
Parameters
30000000000Authors
Yin Luo, Qingchao Kong, Nan Xu, Jia Cao, Bao Hao, Baoyu Qu, Bo Chen, Chao Zhu Chenyang Zhao, Donglei Zhang, Fan Feng, Feifei Zhao, Hailong Sun, Hanxuan Yang, Haojun Pan, Hongyu Liu, Jianbin Guo, Jiangtao Du, Jingyi Wang, Junfeng Li, Lei Sun, Liduo Liu, Lifeng Dong, Lili Liu, Lin Wang, Liwen Zhang, Minzheng Wang, Pin Wang, Ping Yu, Qingxiao Li, Rui Yan, Rui Zou, Ruiqun Li, Taiwen Huang, Xiaodong Wang, Xiaofei Wu, Xin Peng, Xina Zhang, Xing Fang, Xinglin Xiao, Yanni Hao, Yao Dong, Yigang Wang, Ying Liu, Yongyu Jiang, Yungan Wang, Yuqi Wang, Zhangsheng Wang, Zhaoxin Yu, Zhen Luo, Wenji Mao, Lei Wang, Dajun Zeng