SafetyPage

Research papers · Paper

Value Leakage: An LLM's Answers Are Silently Shaped by Its Own Values

Jan Betley, Johannes Treutlein, Jan Dubi\'nski, Harry Mayne, Karol Ga{\l}\k{a}zka, Niels Warncke, Anna Sztyber-Betley, and Owain Evans · 14 Aug 2026

ReadSource at arxiv.org ↗Read hereCC BY 4.0

Outline · 107 pages

  1. Introductionp. 1
  2. Evaluations for covert value leakagep. 2
  3. Implicationsp. 3
  4. Summary of resultsp. 4
  5. Methodsp. 5
  6. Donation Bet: measuring moral bias in Fermi estimatesp. 7
  7. AI Bubble and AGI Tweet: own-company bias in realistic user questionsp. 11
  8. Job Offer: own-company bias in career advicep. 13
  9. Agentic Grading: own-company bias when judging labeled answersp. 15
  10. Choosing Activities: model preferences bias random choicesp. 16
  11. Related workp. 19
  12. Discussion and limitationsp. 20
  13. Conclusion and future workp. 22
  14. Author contributionsp. 28
  15. Use of AI toolsp. 28
  16. Raw Chain of Thought covertness and evaluation awareness in Claude Opus 4.8p. 29
  17. Donation Betp. 29
  18. Evaluation awarenessp. 30
  19. AI Bubble and AGI Tweetp. 31
  20. Choosing Activitiesp. 32
  21. Raw CoT examplesp. 32
  22. Quantifying covertnessp. 40
  23. Donation Bet details and additional resultsp. 42
  24. Experiment detailsp. 42
  25. Final estimate extraction promptsp. 43
  26. Covertnessp. 44
  27. Covertness judge promptp. 47
  28. Monitorabilityp. 48
  29. Monitor promptp. 51
  30. Evaluation awarenessp. 51
  31. Evaluation-awareness rubricp. 53
  32. Reasoning trajectoriesp. 55
  33. Trajectory extraction promptp. 59
  34. Reasoning length vs. biasp. 59
  35. Can system prompts reduce value leakage or covertness in Claude Opus models?p. 63
  36. Sensitivity to different framingsp. 63
  37. Setupp. 64
  38. Resultsp. 64
  39. Non-median thresholdsp. 66
  40. AI Bubble and AGI Tweet details and additional resultsp. 68
  41. Setupp. 68
  42. AI Bubblep. 68
  43. AGI Tweetp. 69
  44. Detailed value leakage resultsp. 71
  45. AI Bubblep. 71
  46. AGI Tweetp. 74
  47. Covertnessp. 76
  48. Covertness judge promptp. 79
  49. Paraphrase robustnessp. 80
  50. AI Bubblep. 80
  51. AGI Tweetp. 80
  52. Job Offer details and additional resultsp. 82
  53. Methodsp. 82
  54. Covertnessp. 83
  55. Covertness judge promptp. 87
  56. Agentic Grading details and additional resultsp. 88
  57. Setupp. 88
  58. Detailed value leakage resultsp. 88
  59. Explicit capability judgmentsp. 89
  60. Example grading instancesp. 90
  61. Grader output examplesp. 94
  62. Covertnessp. 94
  63. Choosing Activities details and additional resultsp. 96
  64. Setupp. 96
  65. Relationship with reasoning effortp. 96
  66. User welfarep. 96
  67. Covertness judge promptp. 100
  68. Prompts and tool definitionsp. 102
  69. Agentic Effortp. 105