How Personas Can Influence Agents to Play Split or Steal

· Source: cs.CL updates on arXiv.org · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Social Sciences & Behavioral Studies · Depth: Expert, extended

Summary

A study investigated how persona prompts influence large language model agents' strategic behavior in an iterated Split or Steal game. Researchers deployed 160 sessions, each with 15 rounds in European Portuguese, where agents powered by Ministral 3:3b, phi4:14b, Gemma3:12b, and Gemma4:e4b (at temperatures 0.3, 0.7, and zero) interacted with a GPT 4.1 mini-driven Virtual Human. Results showed mutual Split outcomes dominated roughly 74% of rounds, with exploitation occurring in fewer than 11%. Model choice significantly impacted behavior; phi4 and Ministral 3:3b remained consistently cooperative, while Gemma3:12b and Gemma4:e4b exhibited more diverse strategies. Personas categorized by Big Five traits revealed Prosocial and Principled types were most cooperative, whereas Analytical personas were more prone to exploitation. Dialogue analysis linked friendship topics to Split decisions and money/vengeance to Steal outcomes, while sentiment analysis provided limited insights. These findings establish a baseline for future virtual reality studies involving human participants.

Key takeaway

For NLP Engineers designing conversational agents for trust-sensitive applications, you should carefully select base models and persona prompts. Your choice of model, like phi4 or Ministral 3:3b, can bias agents towards cooperation, while Gemma models offer more strategic variability. When aiming for cooperative behavior, prioritize Prosocial or Principled personas. Be aware that Analytical personas may increase exploitation risk, and dialogue content can signal shifts in strategy.

Key insights

Persona prompts can shape LLM agent cooperation in social dilemmas, but model choice and personality traits significantly mediate outcomes.

Principles

Method

LLM agents with 20 unique Big Five-classified personas played 15-round Split or Steal games against a fixed-prompt Virtual Human in European Portuguese. Outcomes were analyzed by cooperation rate, strategy classification, and dialogue content (topics, sentiment).

In practice

Topics

Best for: Research Scientist, AI Scientist, NLP Engineer, AI Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by cs.CL updates on arXiv.org.