FLOPs1.12e+25

Notes: https://www.wsj.com/tech/ai/the-9-month-old-ai-startup-challenging-silicon-valleys-giants-ee2e4c48 Mistral spent <20 million euro (meaning approximately 20 million?) to train Mistral Large: https://x.com/EMostaque/status/1762152740938031484?s=20 "assuming this is on H100s with @Scaleway who are €1.9/hour => 10m H100 hours (c 30m A100 hrs), 3 months at 4k H100s :timer_clock:" -Emad Mostaque Assuming bf16 or fp16, H100 SXM performance is 989 TFLOPS At 1.9 euro per H100-hour and 30% utilization, spending 20M euro produces 1.12*10^25 FLOP. https://www.wolframalpha.com/input?i=20+million+%2F+%281.9%2Fhour%29+*+989+TFLOPS+*+0.30