Training compute growth
Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.
Training compute growth
Total 468 · Page 15/19 · Observed 9/25/2026, 3:30:45 AM
| Name | Group | Reported value | Date | Notes | Source |
|---|---|---|---|---|---|
| TransformerXL + spectrum control | University of California Los Angeles (UCLA),JD.com | 26,289,761,000,000,000,000 FLOP | 2020-03-11 | Unreleased | Source ↗ |
| MultiBand Diffusion | Meta AI,Hebrew University of Jerusalem,LORIA | 26,000,000,000,000,000,000 FLOP | 2023-11-08 | Open weights (unrestricted) | Source ↗ |
| Transformer local-attention (NesT-B) | Google Cloud,Google Research | 24,057,600,000,000,000,000 FLOP | 2021-05-26 | Open weights (unrestricted) | Source ↗ |
| MSRA (C, PReLU) | Microsoft Research | 23,974,030,080,000,000,000 FLOP | 2015-02-06 | — | Source ↗ |
| Sandwich Transformer | Allen Institute for AI,Facebook AI Research | 23,504,093,000,000,000,000 FLOP | 2019-11-10 | Unreleased | Source ↗ |
| Detic | Meta AI,University of Texas at Austin | 23,439,974,400,000,000,000 FLOP | 2022-01-07 | Open weights (unrestricted) | Source ↗ |
| KataGo | Jane Street | 23,200,000,000,000,000,000 FLOP | 2019-02-27 | Open weights (unrestricted) | Source ↗ |
| SRU++ Large | ASAPP | 21,173,704,000,000,000,000 FLOP | 2021-02-24 | Open weights (unrestricted) | Source ↗ |
| GPT-1 | OpenAI | 17,578,125,000,000,000,000 FLOP | 2018-06-01 | Open weights (unrestricted) | Source ↗ |
| UnifiedQA | Allen Institute for AI,University of Washington | 16,500,000,000,000,000,000 FLOP | 2020-05-02 | Open weights (unrestricted) | Source ↗ |
| DeepStack | University of Alberta,Charles University,Czech Technical University | 14,463,360,000,000,000,000 FLOP | 2017-01-06 | — | Source ↗ |
| YOLOv3 | University of Washington | 13,416,380,824,000,000,000 FLOP | 2018-04-08 | Unreleased | Source ↗ |
| DistilBERT | Hugging Face | 12,441,600,000,000,000,000 FLOP | 2019-10-02 | Open weights (unrestricted) | Source ↗ |
| SAF R-CNN | Beijing Institute of Technology,Sun Yat-sen University,Panasonic R&D,National University of Singapore | 12,311,081,250,000,001,000 FLOP | 2015-10-28 | Unreleased | Source ↗ |
| VGG16 | University of Oxford | 12,291,000,000,000,000,000 FLOP | 2014-09-04 | — | Source ↗ |
| ResNeXt-101 (64×4d) | University of California San Diego,Facebook | 12,000,000,000,000,000,000 FLOP | 2016-11-16 | Open weights (unrestricted) | Source ↗ |
| Transformer + Simple Recurrent Unit | ASAPP,Cornell University,Google,Princeton University | 11,000,000,000,000,000,000 FLOP | 2018-09-17 | Unreleased | Source ↗ |
| VGG19 | University of Oxford | 11,000,000,000,000,000,000 FLOP | 2014-09-04 | — | Source ↗ |
| Projected GAN | Heidelberg University | 10,500,000,000,000,000,000 FLOP | 2021-11-01 | Open weights (unrestricted) | Source ↗ |
| ResNet-152 (ImageNet) | Microsoft | 10,414,080,000,000,000,000 FLOP | 2015-12-10 | — | Source ↗ |
| VALL-E | Microsoft | 10,100,000,000,000,000,000 FLOP | 2023-01-05 | Unreleased | Source ↗ |
| ProBERTa | University of Illinois Urbana-Champaign (UIUC),Reed College | 9,720,000,000,000,000,000 FLOP | 2020-09-01 | Open weights (non-commercial) | Source ↗ |
| MetNet | 9,510,912,000,000,000,000 FLOP | 2020-03-24 | Unreleased | Source ↗ | |
| MedBERT | Peng Cheng Laboratory,University of Texas at Houston | 9,470,000,000,000,000,000 FLOP | 2021-05-20 | Unreleased | Source ↗ |
| CODEFUSION (Python) | Microsoft,Microsoft Research | 7,920,000,000,000,000,000 FLOP | 2023-10-26 | Unreleased | Source ↗ |
Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample