SafetyPage

Model welfare · Article · Eleos AI Research

Probing persona-dependent preferences in language models

Read at eleosai.org ↗Read at sourceAll rights reserved

Outline · 5 paragraphs

  1. Probing persona-dependent preferences in language models¶2
  2. Large language models (LLMs) can be said to have preferences: they reliably pick certain tasks and outputs over others, and preferences shaped by post-training and system prompts appear to shape much of their behaviour. But models can also adopt different personas which have radically different pref¶3