Persona Cartography: Charting Language Model Personality Traits in Weight Space

· Source: cs.AI updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Cybersecurity & Data Privacy · Depth: Expert, extended

Summary

This research introduces "Persona Cartography," a novel method for decomposing, measuring, and controlling large language model (LLM) behavioral patterns, or personas, in their weight space. The core approach utilizes the psychometrically-grounded OCEAN framework (Openness, Conscientiousness, Extraversion, Agreeableness, Neuroticism) to define model traits. Low-rank adapters (LoRAs) are trained via constitution-guided distillation to amplify or suppress individual OCEAN traits. Evaluations across six models (4B-32B, including Llama-3.1-8B-Instruct, Qwen3, and Gemma-3 families) demonstrate that these LoRAs monotonically shift target traits, combine additively for mixed personas, and largely preserve general capabilities at moderate scales. The study further shows that manipulating these trait axes impacts safety-relevant behaviors, such as neuroticism affecting frustration and agreeableness influencing sycophancy and harmful compliance. An unsupervised psychometric pipeline also recovered four interpretable behavioral factors: Tone, Initiative, Didacticism, and Epistemic Caution.

Key takeaway

For AI scientists and ML engineers developing or deploying LLMs, this research offers a robust method for fine-grained persona control. You can use low-rank adapters to precisely dial in specific personality traits like Openness or Neuroticism, which directly impacts safety-relevant behaviors such as frustration or sycophancy. This allows for more predictable model generalization and alignment, enabling you to tailor model character for high-stakes applications without significantly degrading core capabilities at moderate intervention scales.

Key insights

LLM personas can be precisely controlled in weight space using low-rank adapters based on human personality traits.

Principles

Method

Train LoRAs using constitution-guided distillation (DPO + SFT) to target OCEAN traits. Evaluate with LLM-judges, TRAIT benchmark, and capability tests. Unsupervised factor analysis recovers latent behavioral dimensions.

In practice

Topics

Code references

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, AI Security Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.AI updates on arXiv.org.