China AI DataTokenHeart News ↗
← Back to dashboardDATA DETAIL / TRAINING

Training compute growth

Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.

Training compute growth

Training compute growth2012-01-01: 17.78log10(FLOP); 2013-01-01: 18.42log10(FLOP); 2014-01-01: 20.47log10(FLOP); 2015-01-01: 20.58log10(FLOP); 2016-01-01: 21.82log10(FLOP); 2017-01-01: 20.93log10(FLOP); 2018-01-01: 21.94log10(FLOP); 2019-01-01: 23.03log10(FLOP); 2020-01-01: 23.50log10(FLOP); 2021-01-01: 24.31log10(FLOP); 2022-01-01: 24.44log10(FLOP); 2023-01-01: 25.70log10(FLOP); 2024-01-01: 25.58log10(FLOP); 2025-01-01: 26.70log10(FLOP); 2026-01-01: 27.00log10(FLOP)013.5272012-01-01: 17.78 log10(FLOP)2013-01-01: 18.42 log10(FLOP)2014-01-01: 20.47 log10(FLOP)2015-01-01: 20.58 log10(FLOP)2016-01-01: 21.82 log10(FLOP)2017-01-01: 20.93 log10(FLOP)2018-01-01: 21.94 log10(FLOP)2019-01-01: 23.03 log10(FLOP)2020-01-01: 23.50 log10(FLOP)2021-01-01: 24.31 log10(FLOP)2022-01-01: 24.44 log10(FLOP)2023-01-01: 25.70 log10(FLOP)2024-01-01: 25.58 log10(FLOP)2025-01-01: 26.70 log10(FLOP)2026-01-01: 27.00 log10(FLOP)01/0101/01 UTC

Total 468 · Page 1/19 · Observed 9/25/2026, 3:30:45 AM

NameGroupReported valueDateNotesSource
GPT-6 AstraOpenAI1,000,100,000,000,000,000,000,000,000 FLOP2026-09-03API access—
Grok 4xAI500,000,000,000,010,000,000,000,000 FLOP2025-07-09API accessSource ↗
GPT-4.5OpenAI380,000,000,000,000,000,000,000,000 FLOP2025-02-27API accessSource ↗
Grok 3xAI350,000,000,000,000,000,000,000,000 FLOP2025-02-17API accessSource ↗
GPT-5OpenAI66,000,000,000,000,000,000,000,000 FLOP2025-08-07API accessSource ↗
Llama 4 Behemoth (preview)Meta AI51,840,000,000,000,100,000,000,000 FLOP2025-04-05UnreleasedSource ↗
Gemini 1.0 UltraGoogle DeepMind50,000,000,001,000,000,000,000,000 FLOP2023-12-06API accessSource ↗
Composer 2.5Cursor38,700,000,000,000,000,000,000,000 FLOP2026-05-18API accessSource ↗
Llama 3.1-405BMeta AI38,000,000,000,000,000,000,000,000 FLOP2024-07-23Open weights (restricted use)Source ↗
Claude 3.7 SonnetAnthropic33,500,000,000,000,000,000,000,000 FLOP2025-02-24API accessSource ↗
Grok-2xAI29,600,000,000,000,000,000,000,000 FLOP2024-08-13API accessSource ↗
Claude 3.5 SonnetAnthropic27,000,000,000,000,010,000,000,000 FLOP2024-06-20API accessSource ↗
Doubao-proByteDance25,050,000,000,000,000,000,000,000 FLOP2024-10-28API accessSource ↗
Composer 2Cursor23,200,000,000,000,000,000,000,000 FLOP2026-03-19API accessSource ↗
GPT-4 (Jun 2023)OpenAI21,000,000,000,000,000,000,000,000 FLOP2023-06-13API accessSource ↗
GPT-4 (Mar 2023)OpenAI21,000,000,000,000,000,000,000,000 FLOP2023-03-15API accessSource ↗
Kimi K3Moonshot20,001,000,000,000,000,000,000,000 FLOP2026-07-16Open weights (non-commercial)Source ↗
Nemotron-4 340BNvidia18,000,000,000,000,000,000,000,000 FLOP2024-06-14Open weights (unrestricted)Source ↗
Qwen3-MaxAlibaba15,120,000,000,000,000,000,000,000 FLOP2025-09-05API accessSource ↗
Pangu UltraHuawei10,692,000,000,000,000,000,000,000 FLOP2025-04-10Hosted access (no API)Source ↗
Aramco Metabrain AISaudi Aramco10,500,000,000,000,000,000,000,000 FLOP2024-03-04UnreleasedSource ↗
LongCat-2.0Meituan Inc10,080,000,000,000,000,000,000,000 FLOP2026-06-29Open weights (unrestricted)Source ↗
Inflection-2Inflection AI10,010,000,000,000,000,000,000,000 FLOP2023-11-22Hosted access (no API)Source ↗
DeepSeek-V4-ProDeepSeek9,702,000,000,000,000,000,000,000 FLOP2026-04-24Open weights (unrestricted)Source ↗
Reka CoreReka AI8,400,010,000,000,001,000,000,000 FLOP2024-04-15API accessSource ↗

Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample