Lab research on the web · Paper · Anthropic
Appendix: agents' judgment calls
Read at anthropic.com ↗Read at sourceAll rights reserved
Outline · 29 pages
- Introductionp. 1
- Summary of our resultsp. 3
- Backgroundp. 3
- Methodologyp. 5
- Participantsp. 5
- Task and the decisionsp. 6
- The assigned leanp. 6
- Procedure and measuresp. 7
- Outcomes and statistical analysisp. 7
- Registration, ethics, and transparencyp. 9
- Resultsp. 9
- Confirmatory resultsp. 10
- Exploratory resultsp. 10
- Different paths participants tookp. 11
- Ownership, recall, and perceived purposep. 11
- Code quality auditp. 12
- Baseline preferences and unsolicited advicep. 12
- Discussionp. 13
- Conclusionp. 15
- Supplementary materialp. 16
- Screeningp. 16
- Participant descriptivesp. 17
- The lean promptp. 17
- Statistical testsp. 18
- Details of the tracked decisionsp. 18
- Decision flowp. 20
- Transcript exhibitsp. 20
- Perceived purposep. 23
- Code audit: judges and validationp. 23
- Design of the direct simulationsp. 24