Persona Cartography: Charting Language Model Personality Traits in Weight Space

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning · Depth: Expert, quick

Summary

Persona Cartography research introduces a novel method for decomposing, measuring, and controlling large language model (LLM) personas, which are recurring behavioral patterns impacting generalization and safety. The core insight treats personas as positions in a behavioral trait space, utilizing the OCEAN framework (Openness, Conscientiousness, Extraversion, Agreeableness, Neuroticism). The methodology involves training low-rank adapters to amplify or suppress individual traits, evaluating their effects using an LLM-judge calibrated against a human-validated panel, trait-specific multiple-choice benchmarks, and standard capability evaluations. Across six models (4B-32B) from three families, each adapter largely moves its target trait monotonically with scale, combines approximately additively, and preserves performance at moderate scales. The induced trait axes also affect safety-relevant behaviors, such as neuroticism influencing frustration and agreeableness affecting sycophancy. An unsupervised psychometric pipeline further recovers four interpretable behavioral factors: tone, initiative, didacticism, and epistemic caution.

Key takeaway

For AI scientists and ML engineers developing or deploying large language models, this research offers a novel, quantifiable approach to manage model personality traits, directly impacting generalization and safety. You can now consider fine-tuning models for specific behavioral profiles using low-rank adapters, potentially reducing undesirable traits like sycophancy or frustration while maintaining performance. This enables more predictable and safer AI deployments by providing granular control over model behavior.

Key insights

LLM personas can be precisely controlled and measured as positions in a behavioral trait space using the OCEAN framework and low-rank adapters.

Principles

Method

Train low-rank adapters to amplify/suppress OCEAN traits. Evaluate effects via calibrated LLM-judge, trait-specific benchmarks, and capability tests. Use unsupervised psychometric pipeline for factor recovery.

In practice

Topics

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, AI Ethicist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.