LLMs Generate Kitsch
Summary
A paper submitted to EMNLP 26 by Xenia Klinge, Stefan Ortlieb, and Alexander Koller, titled "LLMs Generate Kitsch," proposes that Large Language Models (LLMs) systematically produce kitsch due to their training methodology. While LLM-generated content, including pictures, texts, music, and videos, often receives higher ratings than human-generated works in controlled studies, it can also appear generic and hollow. The authors argue that this tension is resolved by classifying LLM output as kitsch. Empirical evidence is presented showing that readers perceive LLM-generated stories as kitschier, even when controlling for their individual definitions of "kitsch." The paper discusses the implications of this finding for the design of future studies and for creative applications such as research and coding.
Key takeaway
For AI Product Managers evaluating creative content generation, you should consider the inherent "kitsch" factor in LLM outputs. This suggests that while LLMs may produce technically proficient or highly-rated content, its perceived originality or depth might be compromised. Incorporate metrics beyond simple preference ratings to assess the nuanced artistic value and avoid generic results in your product offerings.
Key insights
LLMs systematically generate kitsch due to their training, despite often outperforming human-generated works in ratings.
Principles
- LLM training leads to generic outputs.
- Perceived quality differs from perceived kitsch.
Method
The study empirically demonstrated that readers perceive LLM-generated stories as kitschier, controlling for individual definitions of kitsch, to support the hypothesis.
In practice
- Re-evaluate LLM output quality metrics.
- Consider "kitsch" in creative AI applications.
Topics
- Large Language Models
- Kitsch Generation
- Creative AI
- Empirical Evaluation
- Model Training Bias
Best for: Research Scientist, AI Product Manager, AI Scientist, NLP Engineer, Creative Technologist
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by cs.CL updates on arXiv.org.