China AI DataTokenHeart News ↗
← Back to dashboardDATA DETAIL / TRAINING

Training compute growth

Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.

Training compute growth

Training compute growth2012-01-01: 17.78log10(FLOP); 2013-01-01: 18.42log10(FLOP); 2014-01-01: 20.47log10(FLOP); 2015-01-01: 20.58log10(FLOP); 2016-01-01: 21.82log10(FLOP); 2017-01-01: 20.93log10(FLOP); 2018-01-01: 21.94log10(FLOP); 2019-01-01: 23.03log10(FLOP); 2020-01-01: 23.50log10(FLOP); 2021-01-01: 24.31log10(FLOP); 2022-01-01: 24.44log10(FLOP); 2023-01-01: 25.70log10(FLOP); 2024-01-01: 25.58log10(FLOP); 2025-01-01: 26.70log10(FLOP); 2026-01-01: 27.00log10(FLOP)013.5272012-01-01: 17.78 log10(FLOP)2013-01-01: 18.42 log10(FLOP)2014-01-01: 20.47 log10(FLOP)2015-01-01: 20.58 log10(FLOP)2016-01-01: 21.82 log10(FLOP)2017-01-01: 20.93 log10(FLOP)2018-01-01: 21.94 log10(FLOP)2019-01-01: 23.03 log10(FLOP)2020-01-01: 23.50 log10(FLOP)2021-01-01: 24.31 log10(FLOP)2022-01-01: 24.44 log10(FLOP)2023-01-01: 25.70 log10(FLOP)2024-01-01: 25.58 log10(FLOP)2025-01-01: 26.70 log10(FLOP)2026-01-01: 27.00 log10(FLOP)01/0101/01 UTC

Total 468 · Page 4/19 · Observed 9/25/2026, 3:30:45 AM

NameGroupReported valueDateNotesSource
DBRXDatabricks2,600,000,000,000,000,000,000,000 FLOP2024-03-27Open weights (restricted use)Source ↗
GPT-3.5 (davinci-002)OpenAI2,578,000,000,000,000,000,000,000 FLOP2022-03-15API accessSource ↗
Flan-PaLM 540BGoogle2,540,000,000,001,000,000,000,000 FLOP2022-10-20UnreleasedSource ↗
U-PaLM (540B)Google2,530,000,000,000,000,000,000,000 FLOP2022-10-20UnreleasedSource ↗
PaLM (540B)Google Research2,527,200,000,000,000,000,000,000 FLOP2022-04-04UnreleasedSource ↗
DeepSeek-V4-FlashDeepSeek2,496,000,000,000,000,000,000,000 FLOP2026-04-24Open weights (unrestricted)Source ↗
Llama 4 MaverickMeta AI2,244,000,000,001,000,000,000,000 FLOP2025-04-05Open weights (restricted use)Source ↗
FLAN 137BGoogle Research2,047,000,000,000,000,000,000,000 FLOP2021-09-03UnreleasedSource ↗
InklingThinking Machines1,845,000,000,000,000,000,000,000 FLOP2026-07-15Open weights (unrestricted)Source ↗
A.X K2SK Telecom1,800,000,000,000,000,000,000,000 FLOP2026-07-29Open weights (unrestricted)Source ↗
Yi-Large01.AI1,800,000,000,000,000,000,000,000 FLOP2024-05-13API access—
DeepSeek-V2.5DeepSeek1,789,200,000,000,000,000,000,000 FLOP2024-09-06Open weights (restricted use)Source ↗
Movie Gen VideoMeta AI1,650,000,000,000,000,000,000,000 FLOP2024-10-04UnreleasedSource ↗
Qwen3-Coder-480B-A35BAlibaba1,575,000,000,000,000,000,000,000 FLOP2025-07-22Open weights (unrestricted)Source ↗
K-EXAONELG AI Research1,520,000,000,000,000,000,000,000 FLOP2025-12-31Open weights (restricted use)Source ↗
Yi-Lightning01.AI1,500,000,000,000,000,000,000,000 FLOP2024-10-16API accessSource ↗
Solar Open 100BUpstage1,400,000,000,000,000,000,000,000 FLOP2025-12-31Open weights (restricted use)Source ↗
Seed1.5-VLByteDance1,388,556,000,000,000,000,000,000 FLOP2025-05-11API accessSource ↗
Qwen1.5-72BAlibaba1,300,000,000,000,000,000,000,000 FLOP2024-02-04Open weights (restricted use)Source ↗
Qwen-72BAlibaba1,300,000,000,000,000,000,000,000 FLOP2023-11-30Open weights (restricted use)Source ↗
DeepSeek-Coder-V2 236BDeepSeek1,285,200,000,000,000,000,000,000 FLOP2024-06-17Open weights (restricted use)Source ↗
EXAONE Deep 32BLG AI Research1,260,000,000,000,000,000,000,000 FLOP2025-03-16Open weights (non-commercial)Source ↗
EXAONE 3.5 32BLG AI Research1,250,000,000,000,000,000,000,000 FLOP2024-12-09Open weights (non-commercial)Source ↗
Motif-3Motif Technologies1,100,000,000,000,000,000,000,000 FLOP2026-08-07Open weights (unrestricted)Source ↗
Olmo 3Allen Institute for AI1,100,000,000,000,000,000,000,000 FLOP2025-11-20Open weights (unrestricted)Source ↗

Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample