Research papers · Paper
Where Animacy Lives in Large Language Models: Tracing the Circuits of the Animacy Concept
Outline · 33 pages
- Introductionp. 1
- Related Workp. 2
- Animacy in Linguistics and Cognitionp. 2
- Animacy in LLMsp. 2
- Circuit discoveryp. 3
- Methodsp. 3
- Datap. 3
- Task and Metricp. 4
- Behavioral Evaluationp. 5
- Circuit discoveryp. 5
- Resultsp. 5
- Animacy circuitp. 5
- Is the circuit robust?p. 6
- Is the circuit necessary?p. 6
- Analysisp. 7
- Functional role of the necessary core componentsp. 7
- A task-specific or a general-purpose animacy circuit?p. 7
- Discussionp. 8
- Dataset Constructionp. 12
- GPT 5.4 promptp. 12
- Semantic filtering promptp. 13
- Semantic score distributionp. 13
- Target constructionp. 13
- Metric Investigationp. 14
- Dataset success filteringp. 14
- EAP-IGp. 18
- Circuit sufficiency and comprehensiveness analysisp. 18
- Circuit necessity analysisp. 18
- Conditional ablation controlp. 19
- Discovery of Backup Circuits After Original-Circuit Ablationp. 19
- Comparison with random initializationsp. 19
- Comparison with random circuitsp. 20
- Construction of the transfer datasetsp. 20
- Setup 2 Circuit Discoveryp. 22
- Necessary core subcircuitsp. 24
- Induced score of necessary circuit componentsp. 26
- Logits contribution of necessary circuit componentsp. 27
- Attention patterns of the necessary circuitp. 28
- Circuit Discovery on Model-Specific vs Shared Datasetsp. 32