Introduction

"MAI-1 is a new large language model (LLM) being developed by Microsoft that’s reportedly as powerful as other leading LLMs including OpenAI’s GPT-4 and Google’s Gemini Ultra. The new model is being overseen by recently hired Mustafa Suleyman – co-founder of Google DeepMind and former CEO of AI startup Inflection – who joined Microsoft in March along with most of the startup’s employees through a deal worth $625 million. Microsoft may reportedly use training data and certain other assets from Inflection AI to train MAI-1. The model’s training dataset is also said to include other types of textual data as well, including text generated by GPT-4 and content scraped from the web. Microsoft is reportedly carrying out the development process using a “large cluster of servers” equipped with Nvidia Corp. graphics cards. The exact purpose of the MAI-1 is not yet known and will depend on how well the model performs. But with a reported 500 parameters, the model is reportedly "far larger" than the smaller, open-source models Microsoft had previously trained."

Benchmarking

Training

Parameters