China AI DataTokenHeart News ↗
← Back to dashboardDATA DETAIL / TRAINING

Training compute growth

Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.

Training compute growth

Training compute growth2012-01-01: 17.78log10(FLOP); 2013-01-01: 18.42log10(FLOP); 2014-01-01: 20.47log10(FLOP); 2015-01-01: 20.58log10(FLOP); 2016-01-01: 21.82log10(FLOP); 2017-01-01: 20.93log10(FLOP); 2018-01-01: 21.94log10(FLOP); 2019-01-01: 23.03log10(FLOP); 2020-01-01: 23.50log10(FLOP); 2021-01-01: 24.31log10(FLOP); 2022-01-01: 24.44log10(FLOP); 2023-01-01: 25.70log10(FLOP); 2024-01-01: 25.58log10(FLOP); 2025-01-01: 26.70log10(FLOP); 2026-01-01: 27.00log10(FLOP)013.5272012-01-01: 17.78 log10(FLOP)2013-01-01: 18.42 log10(FLOP)2014-01-01: 20.47 log10(FLOP)2015-01-01: 20.58 log10(FLOP)2016-01-01: 21.82 log10(FLOP)2017-01-01: 20.93 log10(FLOP)2018-01-01: 21.94 log10(FLOP)2019-01-01: 23.03 log10(FLOP)2020-01-01: 23.50 log10(FLOP)2021-01-01: 24.31 log10(FLOP)2022-01-01: 24.44 log10(FLOP)2023-01-01: 25.70 log10(FLOP)2024-01-01: 25.58 log10(FLOP)2025-01-01: 26.70 log10(FLOP)2026-01-01: 27.00 log10(FLOP)01/0101/01 UTC

Total 468 · Page 3/19 · Observed 9/25/2026, 3:30:45 AM

NameGroupReported valueDateNotesSource
Kimi K2 ThinkingMoonshot4,200,000,000,000,000,000,000,000 FLOP2025-11-06Open weights (restricted use)Source ↗
Llama 4 ScoutMeta AI4,080,000,000,000,000,000,000,000 FLOP2025-04-05Open weights (restricted use)Source ↗
DeepSeek-R1 (May 2025)DeepSeek4,020,010,000,000,001,000,000,000 FLOP2025-05-28Open weights (unrestricted)Source ↗
MegaScale (Production)ByteDance,Peking University3,900,000,000,000,000,000,000,000 FLOP2024-02-23UnreleasedSource ↗
Claude 2Anthropic3,866,000,000,000,000,000,000,000 FLOP2023-07-11API accessSource ↗
EXAONE 4.5LG AI Research3,850,000,000,000,000,000,000,000 FLOP2026-04-09Open weights (restricted use)—
Falcon-180BTechnology Innovation Institute3,760,000,000,000,000,000,000,000 FLOP2023-09-06Open weights (restricted use)Source ↗
LongCat-FlashMeituan Inc3,726,000,000,000,000,000,000,000 FLOP2025-09-01Open weights (unrestricted)Source ↗
K-EXAONE 2.0LG AI Research3,550,000,000,000,000,000,000,000 FLOP2026-07-31Open weights (unrestricted)Source ↗
QwQ-32BAlibaba3,510,000,000,000,000,000,000,000 FLOP2025-03-06Open weights (unrestricted)Source ↗
Qwen2.5-32BAlibaba3,510,000,000,000,000,000,000,000 FLOP2024-09-17Open weights (unrestricted)Source ↗
DeepSeek-R1DeepSeek3,500,000,000,000,000,000,000,000 FLOP2025-01-20Open weights (unrestricted)Source ↗
Hunyuan-LargeTencent3,492,370,000,000,000,000,000,000 FLOP2024-11-06Open weights (restricted use)Source ↗
DeepSeek-V3 (Mar 2025)DeepSeek3,300,000,000,000,000,000,000,000 FLOP2025-03-24Open weights (restricted use)Source ↗
DeepSeek-V3DeepSeek3,300,000,000,000,000,000,000,000 FLOP2024-12-24Open weights (restricted use)Source ↗
GLM-5.3-FlashZ.ai (Zhipu AI)3,240,000,000,000,000,000,000,000 FLOP2026-08-20Open weights (unrestricted)Source ↗
NVLM-X 72BNvidia3,039,818,100,000,000,000,000,000 FLOP2024-10-22UnreleasedSource ↗
LLaVA-OV-72BByteDance,Nanyang Technological University,Chinese University of Hong Kong (CUHK),Hong Kong University of Science and Technology (HKUST)3,036,551,985,824,000,000,000,000 FLOP2024-08-06Open weights (unrestricted)Source ↗
NVLM-H 72BNvidia3,020,000,000,000,000,000,000,000 FLOP2024-10-22UnreleasedSource ↗
NVLM-D 72BNvidia3,020,000,000,000,000,000,000,000 FLOP2024-10-22Open weights (non-commercial)Source ↗
Qwen2-72BAlibaba3,020,000,000,000,000,000,000,000 FLOP2024-06-07Open weights (unrestricted)Source ↗
Kimi K2Moonshot2,976,000,000,000,000,000,000,000 FLOP2025-07-11Open weights (restricted use)Source ↗
Grok-1xAI2,900,000,000,010,000,000,000,000 FLOP2023-11-04Open weights (unrestricted)Source ↗
Minerva (540B)Google2,741,500,000,000,000,000,000,000 FLOP2022-06-29UnreleasedSource ↗
EXAONE 4.0 (32B)LG AI Research2,690,000,000,000,010,000,000,000 FLOP2025-07-15Open weights (non-commercial)Source ↗

Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample