Research papers · Paper
Compositional Multilingual and Behavioral Attribute Steering
Outline · 22 pages
- Introductionp. 1
- Related Workp. 2
- Methodologyp. 3
- Steering Vector Extractionp. 3
- Steering Vector Applicationp. 3
- Compositional Steeringp. 4
- Experimental Setupp. 4
- Data and Modelsp. 4
- Evaluation Metricsp. 4
- Steering and Generation Configurationsp. 5
- Experimental Resultsp. 5
- Single-Attribute Steeringp. 5
- Two-attribute Steeringp. 6
- Three-attribute Steeringp. 7
- Geometry of Steering Vectorsp. 7
- Conclusionp. 8
- Prompt Suffixesp. 11
- Judge Prompt for Output Relevance(OR)p. 11
- English Translations of Qualitative Examplesp. 11
- Selected Layers and Steering Strengths for Multi-Attribute Steeringp. 11
- Disaggregated Single-Attribute Steering Resultsp. 12
- Performance by Language Pairp. 15
- Single-Attribute Steeringp. 15
- Two-Attribute Steeringp. 16
- Three-Attribute Steeringp. 18
- Disaggregated Compositional Steering Resultsp. 18
- Cosine Similarity between Attributes and Individual Languagesp. 20
- Steering Performance Across Composition Conditions by Language Pairp. 22