Training compute growth
Maximum disclosed training compute per year on a log10(FLOP) scale. Missing values remain absent; the current year is incomplete.
Training compute growth
Total 468 · Page 19/19 · Observed 9/25/2026, 3:30:45 AM
| Name | Group | Reported value | Date | Notes | Source |
|---|---|---|---|---|---|
| TA-CNN | Chinese University of Hong Kong (CUHK) | 10,854,000,000,000,000 FLOP | 2014-11-29 | Unreleased | Source ↗ |
| EI-REHN-1000D | Korea Advanced Institute of Science and Technology (KAIST) | 10,600,000,000,000,000 FLOP | 2017-08-14 | Unreleased | Source ↗ |
| NAS with base 8 and shared embeddings | Google Brain | 10,500,000,000,000,000 FLOP | 2016-11-05 | Unreleased | Source ↗ |
| RCTM | University of Oxford | 9,331,200,000,000,000 FLOP | 2013-10-01 | — | Source ↗ |
| Pointer Sentinel-LSTM (medium) | MetaMind Inc,Salesforce | 7,490,000,000,000,000 FLOP | 2016-09-26 | Unreleased | Source ↗ |
| Dropout (MNIST) | University of Toronto | 6,039,370,800,000,000 FLOP | 2012-06-03 | Unreleased | Source ↗ |
| Variational (untied weights, MC) LSTM (Large) | University of Cambridge | 5,886,144,000,000,000 FLOP | 2015-12-16 | Unreleased | Source ↗ |
| Dropout (CIFAR) | University of Toronto | 4,268,700,000,000,000 FLOP | 2012-06-03 | Unreleased | Source ↗ |
| ISS | Duke University,Microsoft | 3,400,000,000,000,000 FLOP | 2017-09-15 | Unreleased | Source ↗ |
| ELMo | University of Washington,Allen Institute for AI | 3,300,100,000,000,010 FLOP | 2018-02-01 | — | Source ↗ |
| AWD-LSTM+WT+Cache+IOG (WT2) | NTT Communication Science Laboratories | 3,180,000,000,000,000 FLOP | 2017-09-26 | Unreleased | Source ↗ |
| DQN | DeepMind | 2,846,883,840,000,000 FLOP | 2013-12-19 | — | Source ↗ |
| PyramidNet | Korea Advanced Institute of Science and Technology (KAIST) | 2,340,000,000,000,000 FLOP | 2017-09-06 | Open weights (unrestricted) | Source ↗ |
| Multi-cell LSTM | University of Hyderabad | 2,006,640,000,000,000 FLOP | 2018-11-15 | Unreleased | Source ↗ |
| LSTM+NeuralCache | KU Leuven,ESAT - PSI,Apple | 982,800,000,000,000 FLOP | 2018-09-24 | Unreleased | Source ↗ |
| ADAM (CIFAR-10) | University of Amsterdam,OpenAI,University of Toronto | 624,979,800,000,000 FLOP | 2014-12-22 | Unreleased | Source ↗ |
| Image generation | University of Amsterdam | 475,200,000,000,000 FLOP | 2013-12-20 | — | Source ↗ |
| ACF-WIDER | Chinese Academy of Sciences | 76,380,000,000,000 FLOP | 2014-07-15 | Unreleased | Source ↗ |
Data: Epoch AI · CC BY · View source · Automatically synced; not an exhaustive global sample