TokenHeart News ↗
← Back to dashboardDATA DETAIL / TRAINING

Training compute growth

Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.

Training compute growth

Training compute growth2012-01-01: 17.78log10(FLOP); 2013-01-01: 18.42log10(FLOP); 2014-01-01: 20.47log10(FLOP); 2015-01-01: 20.58log10(FLOP); 2016-01-01: 21.82log10(FLOP); 2017-01-01: 20.93log10(FLOP); 2018-01-01: 21.94log10(FLOP); 2019-01-01: 23.03log10(FLOP); 2020-01-01: 23.50log10(FLOP); 2021-01-01: 24.31log10(FLOP); 2022-01-01: 24.44log10(FLOP); 2023-01-01: 25.70log10(FLOP); 2024-01-01: 25.58log10(FLOP); 2025-01-01: 26.70log10(FLOP); 2026-01-01: 26.97log10(FLOP)013.5272012-01-01: 17.78 log10(FLOP)2013-01-01: 18.42 log10(FLOP)2014-01-01: 20.47 log10(FLOP)2015-01-01: 20.58 log10(FLOP)2016-01-01: 21.82 log10(FLOP)2017-01-01: 20.93 log10(FLOP)2018-01-01: 21.94 log10(FLOP)2019-01-01: 23.03 log10(FLOP)2020-01-01: 23.50 log10(FLOP)2021-01-01: 24.31 log10(FLOP)2022-01-01: 24.44 log10(FLOP)2023-01-01: 25.70 log10(FLOP)2024-01-01: 25.58 log10(FLOP)2025-01-01: 26.70 log10(FLOP)2026-01-01: 26.97 log10(FLOP)01/0101/01 UTC

Total 471 · Page 2/19 · Sample synced 11/09, 03:30 UTC

NameGroupReported valueDateNotesSource
Inflection-2Inflection AI10,010,000,000,000,000,000,000,000 FLOP2023-11-22Hosted access (no API)Source ↗
DeepSeek-V4-ProDeepSeek9,702,000,000,000,000,000,000,000 FLOP2026-04-24Open weights (unrestricted)Source ↗
Reka CoreReka AI8,400,010,000,000,001,000,000,000 FLOP2024-04-15API accessSource ↗
Inflection-2.5Inflection AI8,000,001,000,000,000,000,000,000 FLOP2024-03-07Hosted access (no API)Source ↗
Llama-3.1-Nemotron-70B-InstructNvidia,Meta AI7,929,000,000,000,000,000,000,000 FLOP2024-10-12Open weights (restricted use)Source ↗
Llama 3-70BMeta AI7,861,000,000,000,000,000,000,000 FLOP2024-04-18Open weights (restricted use)Source ↗
Qwen2.5 Instruct (72B)Alibaba7,851,600,000,000,000,000,000,000 FLOP2024-09-19Open weights (restricted use)Source ↗
Qwen2.5-72BAlibaba7,800,000,000,000,000,000,000,000 FLOP2024-09-19Open weights (unrestricted)Source ↗
PaLM 2Google7,340,000,000,000,000,000,000,000 FLOP2023-05-10API accessSource ↗
Telechat2-115BChina Telecom6,900,000,000,000,000,000,000,000 FLOP2024-09-20Open weights (restricted use)Source ↗
Llama 3.3 70BMeta AI6,864,976,800,000,000,000,000,000 FLOP2024-12-06Open weights (restricted use)Source ↗
GLM-5Z.ai (Zhipu AI)6,840,000,000,000,000,000,000,000 FLOP2026-02-12Open weights (unrestricted)Source ↗
MiMo-V2.5-ProXiaomi Corp6,804,000,000,000,000,000,000,000 FLOP2026-04-23Open weights (unrestricted)Source ↗
Nemotron 3 UltraNvidia6,600,000,000,000,000,000,000,000 FLOP2026-06-04Open weights (unrestricted)Source ↗
Amazon Nova ProAmazon6,000,010,000,000,001,000,000,000 FLOP2024-12-03API accessSource ↗
Ling-1TAnt Group6,000,001,000,000,000,000,000,000 FLOP2025-10-10Open weights (unrestricted)Source ↗
Kimi K2.5Moonshot5,800,000,000,000,000,000,000,000 FLOP2026-02-02Open weights (unrestricted)Source ↗
Hunyuan-TurboSTencent5,400,000,000,000,000,000,000,000 FLOP2025-03-11API accessSource ↗
Qwen3-VL-235B-A22BAlibaba5,038,044,000,000,000,000,000,000 FLOP2025-09-23Open weights (unrestricted)Source ↗
gpt-oss-120bOpenAI4,940,000,000,000,000,000,000,000 FLOP2025-08-05Open weights (unrestricted)Source ↗
Amazon TitanAmazon4,800,000,000,000,000,000,000,000 FLOP2023-09-28API accessSource ↗
Qwen3-235B-A22B-Thinking (Jul 2025)Alibaba4,752,000,000,000,000,000,000,000 FLOP2025-07-25Open weights (unrestricted)Source ↗
Qwen3-235B-A22B (Jul 2025)Alibaba4,752,000,000,000,000,000,000,000 FLOP2025-07-25Open weights (unrestricted)Source ↗
Qwen3-235B-A22BAlibaba4,752,000,000,000,000,000,000,000 FLOP2025-04-29Open weights (unrestricted)Source ↗
GLM-4.7Z.ai (Zhipu AI)4,420,000,000,000,000,000,000,000 FLOP2025-12-22Open weights (unrestricted)Source ↗

Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample