SafetyPage

Research papers · Paper

Memory vs. Context? Influential Factors of Factual Recall in Language Models

Guilhem Fouilh\'e and Nicholas Asher and Philippe Muller · 21 Sep 2026

ReadSource at arxiv.org ↗Read hereCC BY 4.0

Outline · 18 pages

  1. Introductionp. 1
  2. Related Workp. 2
  3. Methodsp. 2
  4. Task formulationp. 2
  5. Experimental designp. 3
  6. Modelsp. 3
  7. Answer classificationp. 4
  8. Training-frequency proxyp. 4
  9. Mechanistic analysis: logit lensp. 4
  10. Resultsp. 4
  11. Model sizes and memorizationp. 4
  12. Country frequency and memorizationp. 5
  13. Context length and filler tokensp. 5
  14. Late-layer direct decodability: cross-family logit lensp. 6
  15. Discussionp. 6
  16. Conclusionp. 6
  17. Baseline Factual Recall Without Conflictp. 9
  18. Context-length: all fillersp. 9
  19. Cross-family generalization of unrelated prose (L=128)p. 9
  20. Conflict position: front, middle, and tailp. 9
  21. Post-training effects by model sizep. 10
  22. Model size vs. memorization by familyp. 10
  23. Effect of Coherent Conflictp. 10
  24. Correlation Between Generative and Log-Probability Classifiersp. 11
  25. Country frequency and memorization: full resultsp. 11
  26. ParaConflict entity word frequenciesp. 11
  27. Alternative question template and cross-family phrasing sensitivityp. 11
  28. Negated conflict statementp. 13
  29. Conflict repetitionp. 13
  30. Model Checkpoints and Inference Interfacep. 13