SafetyPage

Research papers · Paper

Recurrence Is Not Enough: Causally Validating Multilingual SAE Translation Features in Gemma 2 and 3

Giang Son Nguyen, Nhi Ngoc-Yen Nguyen, Wray Buntine, Dung D. Le · 4 Sep 2026

ReadSource at arxiv.org ↗Read hereCC BY 4.0

Outline · 13 pages

  1. Introductionp. 1
  2. Related Workp. 2
  3. Methodp. 2
  4. Notationp. 2
  5. Feature discoveryp. 3
  6. Cross-lingual candidate selectionp. 3
  7. Dataset, model, and evaluationp. 3
  8. Resultsp. 4
  9. Most overlapping features do not causally transferp. 4
  10. A single feature generalizes across multiple language settingsp. 5
  11. Dose-response sanity checkp. 5
  12. Task-specificity checkp. 6
  13. Feature interpretationp. 6
  14. Conclusionp. 6
  15. Implementation Detailsp. 9
  16. Reproducibility detailsp. 9
  17. Interpretation and Qualitative examplesp. 9
  18. Non-core features in en2zh_enp. 9
  19. Task-specificity evaluation detailsp. 9
  20. chrF++ evaluationp. 9