China AI DataTokenHeart News ↗
← Back to dashboardDATA DETAIL / TRAINING

Training compute growth

Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.

Training compute growth

Training compute growth2012-01-01: 17.78log10(FLOP); 2013-01-01: 18.42log10(FLOP); 2014-01-01: 20.47log10(FLOP); 2015-01-01: 20.58log10(FLOP); 2016-01-01: 21.82log10(FLOP); 2017-01-01: 20.93log10(FLOP); 2018-01-01: 21.94log10(FLOP); 2019-01-01: 23.03log10(FLOP); 2020-01-01: 23.50log10(FLOP); 2021-01-01: 24.31log10(FLOP); 2022-01-01: 24.44log10(FLOP); 2023-01-01: 25.70log10(FLOP); 2024-01-01: 25.58log10(FLOP); 2025-01-01: 26.70log10(FLOP); 2026-01-01: 27.00log10(FLOP)013.5272012-01-01: 17.78 log10(FLOP)2013-01-01: 18.42 log10(FLOP)2014-01-01: 20.47 log10(FLOP)2015-01-01: 20.58 log10(FLOP)2016-01-01: 21.82 log10(FLOP)2017-01-01: 20.93 log10(FLOP)2018-01-01: 21.94 log10(FLOP)2019-01-01: 23.03 log10(FLOP)2020-01-01: 23.50 log10(FLOP)2021-01-01: 24.31 log10(FLOP)2022-01-01: 24.44 log10(FLOP)2023-01-01: 25.70 log10(FLOP)2024-01-01: 25.58 log10(FLOP)2025-01-01: 26.70 log10(FLOP)2026-01-01: 27.00 log10(FLOP)01/0101/01 UTC

Total 468 · Page 5/19 · Observed 9/25/2026, 3:30:45 AM

NameGroupReported valueDateNotesSource
ESM3 (98B)EvolutionaryScale,University of California (UC) Berkeley1,070,000,000,000,000,000,000,000 FLOP2024-06-25UnreleasedSource ↗
ALLaM adapted 70BSaudi Data and Artificial Intelligence Authority1,062,000,000,000,000,000,000,000 FLOP2024-05-21UnreleasedSource ↗
Solar Open2 250BUpstage1,050,000,000,000,000,000,000,000 FLOP2026-06-28Open weights (unrestricted)Source ↗
ERNIE 3.0 TitanBaidu,Peng Cheng Laboratory1,042,100,000,000,000,000,000,000 FLOP2021-12-23Hosted access (no API)Source ↗
InternLMShanghai AI Lab,SenseTime998,400,000,000,000,000,000,000 FLOP2023-07-06UnreleasedSource ↗
Megatron-Turing NLG 530BMicrosoft,Nvidia858,600,000,000,000,000,000,000 FLOP2021-10-11UnreleasedSource ↗
Llama 2-70BMeta AI810,000,000,000,000,000,000,000 FLOP2023-07-18Open weights (restricted use)Source ↗
Mixtral 8x7BMistral AI774,000,000,000,000,000,000,000 FLOP2023-12-11Open weights (unrestricted)Source ↗
AgentFounder-30BAlibaba653,670,000,000,000,000,000,000 FLOP2025-09-16Open weights (unrestricted)Source ↗
Gopher (280B)DeepMind631,000,000,000,000,000,000,000 FLOP2021-12-08UnreleasedSource ↗
xTrimoPGLM -100BTsinghua University,BioMap Research620,000,000,000,000,000,000,000 FLOP2023-07-06UnreleasedSource ↗
Yi-34B01.AI610,000,000,000,000,000,000,000 FLOP2023-11-02Open weights (restricted use)Source ↗
Llama 3.2 11BMeta AI579,000,000,000,000,000,000,000 FLOP2024-09-24Open weights (restricted use)Source ↗
ChinchillaDeepMind576,000,000,000,000,000,000,000 FLOP2022-03-29UnreleasedSource ↗
PaLI-XGoogle Research560,000,000,000,000,000,000,000 FLOP2023-05-29UnreleasedSource ↗
LLaMA-65BMeta AI550,000,000,000,000,000,000,000 FLOP2023-02-24Open weights (non-commercial)Source ↗
gpt-oss-20bOpenAI549,000,000,000,000,000,000,000 FLOP2025-08-05Open weights (unrestricted)Source ↗
PartiGoogle Research509,607,936,000,000,000,000,000 FLOP2022-06-22UnreleasedSource ↗
MM1-30BApple486,000,000,000,000,000,000,000 FLOP2024-03-14UnreleasedSource ↗
Nemotron 3-Nano-30B-A3BNvidia480,000,000,000,000,000,000,000 FLOP2025-12-15Open weights (restricted use)Source ↗
PanGu-ΣHuawei Noah's Ark Lab467,000,000,000,000,000,000,000 FLOP2023-03-20UnreleasedSource ↗
AFM-on-deviceApple451,260,000,000,000,000,000,000 FLOP2024-07-29Hosted access (no API)Source ↗
BlenderBot 3McGill University,Meta AI,Mila - Quebec AI (originally Montreal Institute for Learning Algorithms)430,000,000,000,000,000,000,000 FLOP2022-08-10Open weights (non-commercial)Source ↗
OPT-175BMeta AI430,000,000,000,000,000,000,000 FLOP2022-05-02Open weights (non-commercial)Source ↗
FunSearchGoogle DeepMind387,000,000,000,000,000,000,000 FLOP2023-12-14Open weights (unrestricted)Source ↗

Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample