China AI DataTokenHeart News ↗
← Back to dashboardDATA DETAIL / TRAINING

Training compute growth

Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.

Training compute growth

Training compute growth2012-01-01: 17.78log10(FLOP); 2013-01-01: 18.42log10(FLOP); 2014-01-01: 20.47log10(FLOP); 2015-01-01: 20.58log10(FLOP); 2016-01-01: 21.82log10(FLOP); 2017-01-01: 20.93log10(FLOP); 2018-01-01: 21.94log10(FLOP); 2019-01-01: 23.03log10(FLOP); 2020-01-01: 23.50log10(FLOP); 2021-01-01: 24.31log10(FLOP); 2022-01-01: 24.44log10(FLOP); 2023-01-01: 25.70log10(FLOP); 2024-01-01: 25.58log10(FLOP); 2025-01-01: 26.70log10(FLOP); 2026-01-01: 27.00log10(FLOP)013.5272012-01-01: 17.78 log10(FLOP)2013-01-01: 18.42 log10(FLOP)2014-01-01: 20.47 log10(FLOP)2015-01-01: 20.58 log10(FLOP)2016-01-01: 21.82 log10(FLOP)2017-01-01: 20.93 log10(FLOP)2018-01-01: 21.94 log10(FLOP)2019-01-01: 23.03 log10(FLOP)2020-01-01: 23.50 log10(FLOP)2021-01-01: 24.31 log10(FLOP)2022-01-01: 24.44 log10(FLOP)2023-01-01: 25.70 log10(FLOP)2024-01-01: 25.58 log10(FLOP)2025-01-01: 26.70 log10(FLOP)2026-01-01: 27.00 log10(FLOP)01/0101/01 UTC

Total 468 · Page 6/19 · Observed 9/25/2026, 3:30:45 AM

NameGroupReported valueDateNotesSource
Jurassic-1-JumboAI21 Labs370,000,000,000,000,000,000,000 FLOP2021-08-11API accessSource ↗
BLOOM-176BHugging Face,BigScience365,664,000,000,000,000,000,000 FLOP2022-07-11Open weights (restricted use)Source ↗
GLaMGoogle363,631,124,340,000,000,000,000 FLOP2021-12-13UnreleasedSource ↗
LaMDAGoogle355,000,000,000,000,000,000,000 FLOP2022-02-10UnreleasedSource ↗
GLM-130BTsinghua University354,900,549,450,000,000,000,000 FLOP2022-08-04Open weights (non-commercial)Source ↗
Yuan 1.0Inspur353,800,000,000,010,000,000,000 FLOP2021-10-12API accessSource ↗
DALL·E 2OpenAI336,957,840,000,000,000,000,000 FLOP2022-04-06API accessSource ↗
GalacticaMeta AI324,000,000,000,000,000,000,000 FLOP2022-11-16Open weights (non-commercial)Source ↗
InstructGPT 175BOpenAI319,181,000,000,000,000,000,000 FLOP2022-01-27API accessSource ↗
GPT-3 175B (davinci)OpenAI314,000,000,000,000,000,000,000 FLOP2020-05-28API accessSource ↗
ST-MoEGoogle,Google Brain,Google Research290,000,000,000,000,000,000,000 FLOP2022-02-17UnreleasedSource ↗
nekomata-14brinna255,620,000,000,000,000,000,000 FLOP2023-12-21Open weights (restricted use)Source ↗
Skywork-13BKunlun Inc.250,000,000,000,000,000,000,000 FLOP2023-10-30Open weights (restricted use)Source ↗
Falcon-40BTechnology Innovation Institute240,000,000,000,000,000,000,000 FLOP2023-03-15Open weights (unrestricted)Source ↗
AlphaCodeDeepMind238,010,000,000,001,000,000,000 FLOP2022-02-02UnreleasedSource ↗
BloombergGPTBloomberg,Johns Hopkins University236,000,000,000,000,000,000,000 FLOP2023-03-30UnreleasedSource ↗
FlamingoDeepMind218,972,000,000,001,000,000,000 FLOP2022-04-29UnreleasedSource ↗
WeatherNext 3Google DeepMind,Google Research207,251,983,840,000,000,000,000 FLOP2026-09-03Hosted access (no API)Source ↗
AlexaTM 20BAmazon204,374,016,000,000,000,000,000 FLOP2022-08-02API accessSource ↗
HyperCLOVA 204BNAVER200,000,000,010,000,000,000,000 FLOP2021-09-10Hosted access (no API)Source ↗
ViT-22BGoogle193,248,000,000,000,000,000,000 FLOP2023-02-10UnreleasedSource ↗
Nemotron-3-8BNvidia180,000,000,000,000,000,000,000 FLOP2023-11-15Open weights (restricted use)Source ↗
PaLIGoogle169,000,000,000,000,000,000,000 FLOP2022-09-14UnreleasedSource ↗
Llama GuardMeta AI160,000,000,000,000,000,000,000 FLOP2023-12-07Open weights (restricted use)Source ↗
FinGPT-13BUniversity of California Los Angeles (UCLA),Columbia University,New York University (NYU)160,000,000,000,000,000,000,000 FLOP2023-10-07Open weights (unrestricted)Source ↗

Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample