SafetyPage

Research papers · Paper

A Survey on the Linear Representation Hypothesis

Sewoong Lee, Marc E. Canby, Ikhyun Cho, Julia Hockenmaier · 19 Sep 2026

ReadSource at arxiv.org ↗Read hereCC BY 4.0

Outline · 17 pages

  1. Introductionp. 1
  2. Formulation of the LRHp. 2
  3. Origins of the LRHp. 2
  4. Early Empirical Findingsp. 2
  5. The Strong, the Weak and the Causalp. 2
  6. Target Embedding Layersp. 5
  7. Gap between Theory and Experimentp. 6
  8. What exactly is hypothetical in LRH?p. 7
  9. LRH as a Statistical Hypothesisp. 7
  10. LRH as a Scientific Hypothesisp. 7
  11. From Slogan to Statementp. 8
  12. Open problemsp. 9
  13. Conclusionp. 9
  14. Connections Between Definitionsp. 15
  15. Beyond the Final Layerp. 15
  16. The Fourth Definitionp. 15
  17. Probing Literature Related to the LRHp. 16