Persona Cartography: Charting Language Model Personality Traits in Weight Space
Summary
Persona Cartography research introduces a novel method for decomposing, measuring, and controlling large language model (LLM) personas, which are recurring behavioral patterns impacting generalization and safety. The core insight treats personas as positions in a behavioral trait space, utilizing the OCEAN framework (Openness, Conscientiousness, Extraversion, Agreeableness, Neuroticism). The methodology involves training low-rank adapters to amplify or suppress individual traits, evaluating their effects using an LLM-judge calibrated against a human-validated panel, trait-specific multiple-choice benchmarks, and standard capability evaluations. Across six models (4B-32B) from three families, each adapter largely moves its target trait monotonically with scale, combines approximately additively, and preserves performance at moderate scales. The induced trait axes also affect safety-relevant behaviors, such as neuroticism influencing frustration and agreeableness affecting sycophancy. An unsupervised psychometric pipeline further recovers four interpretable behavioral factors: tone, initiative, didacticism, and epistemic caution.
Key takeaway
For AI scientists and ML engineers developing or deploying large language models, this research offers a novel, quantifiable approach to manage model personality traits, directly impacting generalization and safety. You can now consider fine-tuning models for specific behavioral profiles using low-rank adapters, potentially reducing undesirable traits like sycophancy or frustration while maintaining performance. This enables more predictable and safer AI deployments by providing granular control over model behavior.
Key insights
LLM personas can be precisely controlled and measured as positions in a behavioral trait space using the OCEAN framework and low-rank adapters.
Principles
- LLM traits move monotonically with adapter scale.
- Adapters combine additively for mixed personas.
- Trait control preserves capability at moderate scales.
Method
Train low-rank adapters to amplify/suppress OCEAN traits. Evaluate effects via calibrated LLM-judge, trait-specific benchmarks, and capability tests. Use unsupervised psychometric pipeline for factor recovery.
In practice
- Fine-tune LLMs for specific personality traits.
- Mitigate sycophancy or frustration in models.
- Develop models with desired social behaviors.
Topics
- Language Models
- Persona Cartography
- OCEAN Framework
- Low-Rank Adapters
- AI Safety
- Model Editing
Best for: Research Scientist, AI Scientist, Machine Learning Engineer, AI Ethicist
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.