Evaluators and safety organisations · Article · Epoch AI

Changing how we measure AI chip inference performance

9 Nov 2026

Outline · 52 paragraphs

The tradeoff between concurrency and output speed¶7
How we calculate the IPI¶15
Comparing capacity across output speeds¶27
Combining the model comparisons¶32
Interpreting the IPI¶36
Acknowledgements¶42

How to cite

A citation names the document, the version and the place.

epoch:inference-performance-index/r1/b1

https://safetypage.noahairmet.com/d/epoch/inference-performance-index/r1/b1

BibTeX

@misc{epochai2026,
  title = {Changing how we measure AI chip inference performance},
  author = {{Epoch AI}},
  year = {2026},
  url = {https://epoch.ai/publications/inference-performance-index}
}

Versions

Version	Published	Read
r1 latest	9 Nov 2026	At source

Licence

So you: Search it, cite it and check quotes here; read it at its source
Read at: epoch.ai/publications/inference-performance-index, 10 Nov 2026