China AI DataTokenHeart News ↗
← Back to dashboardDATA DETAIL / TRAINING

Training compute growth

Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.

Training compute growth

Training compute growth2012-01-01: 17.78log10(FLOP); 2013-01-01: 18.42log10(FLOP); 2014-01-01: 20.47log10(FLOP); 2015-01-01: 20.58log10(FLOP); 2016-01-01: 21.82log10(FLOP); 2017-01-01: 20.93log10(FLOP); 2018-01-01: 21.94log10(FLOP); 2019-01-01: 23.03log10(FLOP); 2020-01-01: 23.50log10(FLOP); 2021-01-01: 24.31log10(FLOP); 2022-01-01: 24.44log10(FLOP); 2023-01-01: 25.70log10(FLOP); 2024-01-01: 25.58log10(FLOP); 2025-01-01: 26.70log10(FLOP); 2026-01-01: 27.00log10(FLOP)013.5272012-01-01: 17.78 log10(FLOP)2013-01-01: 18.42 log10(FLOP)2014-01-01: 20.47 log10(FLOP)2015-01-01: 20.58 log10(FLOP)2016-01-01: 21.82 log10(FLOP)2017-01-01: 20.93 log10(FLOP)2018-01-01: 21.94 log10(FLOP)2019-01-01: 23.03 log10(FLOP)2020-01-01: 23.50 log10(FLOP)2021-01-01: 24.31 log10(FLOP)2022-01-01: 24.44 log10(FLOP)2023-01-01: 25.70 log10(FLOP)2024-01-01: 25.58 log10(FLOP)2025-01-01: 26.70 log10(FLOP)2026-01-01: 27.00 log10(FLOP)01/0101/01 UTC

Total 468 · Page 7/19 · Observed 9/25/2026, 3:30:45 AM

NameGroupReported valueDateNotesSource
UL2Google Research,Google Brain120,000,000,000,000,000,000,000 FLOP2022-05-10Open weights (unrestricted)Source ↗
MeenaGoogle Brain112,000,000,000,000,000,000,000 FLOP2020-01-28UnreleasedSource ↗
OpenVLAStanford University,University of California (UC) Berkeley,Toyota Research Institute,Google DeepMind,Massachusetts Institute of Technology (MIT),Physical Intelligence110,000,000,000,000,000,000,000 FLOP2024-06-13Open weights (unrestricted)Source ↗
AlphaStarDeepMind107,734,000,010,000,000,000,000 FLOP2019-10-30UnreleasedSource ↗
GPT-NeoX-20BEleutherAI93,162,700,800,000,000,000,000 FLOP2022-02-09Open weights (unrestricted)Source ↗
StarCoderHugging Face,ServiceNow,Northeastern University,Mila - Quebec AI (originally Montreal Institute for Learning Algorithms),Carnegie Mellon University (CMU),Johns Hopkins University,Leipzig University,ScaDS.AI,Queen Mary University of London,Roblox,Sea AI Lab,Technion - Israel Institute of Technology,Monash University,CSIRO,Data61,McGill University,Saama,University of British Columbia (UBC),Massachusetts Institute of Technology (MIT),Technical University of Munich,IBM,University of Vermont,UnfoldML,SAP,University of Notre Dame,Columbia University,New York University (NYU),University of Allahabad,Discover Dollar,Toloka,Telefonica,Stanford University,Weizmann Institute of Science,Alan Turing Institute,Wellesley College,EleutherAI,Forschungszentrum Julich84,600,000,000,000,000,000,000 FLOP2023-05-09Open weights (restricted use)Source ↗
Llama 2-7BMeta AI84,000,000,000,000,000,000,000 FLOP2023-07-18Open weights (restricted use)Source ↗
SwitchGoogle82,200,000,000,000,000,000,000 FLOP2021-01-11Open weights (unrestricted)Source ↗
mT5-XXLGoogle,Google Research82,000,000,000,000,000,000,000 FLOP2020-10-20Open weights (unrestricted)Source ↗
ByT5-XXLGoogle,Google Research81,000,000,000,000,000,000,000 FLOP2021-05-28Open weights (unrestricted)Source ↗
LLaVA 1.5University of Wisconsin Madison,Microsoft Research78,070,000,000,000,000,000,000 FLOP2023-11-05Open weights (restricted use)Source ↗
LLaVAUniversity of Wisconsin Madison,Microsoft Research,Columbia University78,049,000,000,000,000,000,000 FLOP2023-04-17Open weights (unrestricted)Source ↗
Vega v2Wuhan University,JD Explore Academy,Shanghai AI Lab,Nanyang Technological University,Washington University in St Louis,Chongqing University of Posts and Telecommunications,University of Sydney77,600,000,000,000,000,000,000 FLOP2022-12-04UnreleasedSource ↗
ESM2-15BMeta AI,New York University (NYU),Stanford University,Massachusetts Institute of Technology (MIT)73,500,000,000,100,000,000,000 FLOP2022-07-21Open weights (unrestricted)Source ↗
CodexOpenAI73,440,000,000,000,000,000,000 FLOP2021-07-07API accessSource ↗
CoCaGoogle Research73,000,000,000,000,000,000,000 FLOP2022-06-14UnreleasedSource ↗
CogAgentTsinghua University,Z.ai (Zhipu AI)67,070,000,000,000,000,000,000 FLOP2023-12-14Open weights (restricted use)Source ↗
OpenAI FiveOpenAI67,000,000,000,000,000,000,000 FLOP2019-12-13UnreleasedSource ↗
CogVLM-17BTsinghua University,Z.ai (Zhipu AI),Beihang University63,310,000,000,000,000,000,000 FLOP2023-11-06Open weights (restricted use)Source ↗
ViT-G/14Google Brain,Google Research58,500,000,000,000,000,000,000 FLOP2021-06-08UnreleasedSource ↗
ChatGLM3-6BZ.ai (Zhipu AI)50,400,000,000,000,000,000,000 FLOP2023-10-27Open weights (restricted use)Source ↗
Stable Diffusion 3Stability AI50,000,000,000,000,004,000,000 FLOP2024-02-22API accessSource ↗
Stable Diffusion (LDM-KL-8-G)Runway,Ludwig Maximilian University of Munich,Heidelberg University50,000,000,000,000,004,000,000 FLOP2022-04-13Open weights (unrestricted)Source ↗
JaisCerebras Systems,Mohamed bin Zayed University of Artificial Intelligence (MBZUAI),Inception G4248,946,763,000,000,000,000,000 FLOP2023-08-29Open weights (unrestricted)Source ↗
FlorenceMicrosoft48,310,000,000,000,000,000,000 FLOP2021-11-22UnreleasedSource ↗

Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample