Effects of Varying LLM Access on Essay Writing Behavior

2026-06-25 · Source: Paper Index on ACL Anthology · Field: Education & Learning — Educational Technology (EdTech), Educational Psychology & Learning Sciences, Academic Research & Higher Education · Depth: Expert, medium

Summary

The study by Christenson et al. (BEA 2026) investigated how varying Large Language Model (LLM) access affects college students' essay writing behavior. A pilot study with 24 students assigned to no LLM, limited LLM (<=3 prompts, 100-word responses), or unlimited LLM access found overall essay quality statistically indistinguishable across groups. However, writing behavior and perceived authorship diverged sharply. Students with limited access reported higher ownership (62.5% would submit the essay as independent work, vs. 25% in the unlimited group), showed stronger organizational gains, and used more strategic, revision-focused prompting. The unlimited group spent more time writing, produced essays more similar to LLM output, and reported reduced creative expression. These findings suggest that constraining, rather than banning, LLM access may preserve authorship confidence while retaining the scaffolding benefits of AI assistance.

Key takeaway

For university educators designing writing assignments, you should consider implementing constrained LLM access policies. Limiting prompts to three and capping responses at 100 words can preserve student authorship confidence and foster strategic revision, unlike unlimited access which may reduce creative expression. This approach allows students to benefit from AI scaffolding without undermining their sense of ownership.

Key insights

Constraining LLM access in education preserves student authorship and creative expression while retaining scaffolding benefits.

Principles

• Limited LLM access fosters higher student ownership.
• Unrestricted LLM use can reduce creative expression.
• Essay quality may not vary with LLM access levels.

Method

A pilot study assigned 24 college students to write essays under three conditions: no LLM, limited LLM (<=3 prompts, 100-word responses), or unlimited LLM access.

In practice

• Implement prompt limits for student LLM use.
• Cap LLM response length in writing assignments.
• Encourage revision-focused LLM interactions.

Topics

• Large Language Models
• Educational Technology
• Essay Writing
• Student Authorship
• AI Assistance
• Writing Pedagogy

Best for: AI Scientist, Research Scientist, AI Ethicist

Related on AIssential

• How Software Engineering Students Use LLMs to Write Research Papers: An Experience Report — Students use LLMs across academic writing, balancing utility for clarity and organization with critical verification of AI-generated content.
• Engagement Intensity as a Learner-Modeling Signal for Adaptive AI Ethics Instruction — Self-reported LLM usage frequency is a strong, simple signal for profiling learners' AI perceptions in ethics education.
• Automated Reformulation of Argumentative Essays to Improve Argument Organization and Development — LLMs can provide targeted, explainable feedback on argumentative essay quality by reformulating text.
• Using AI for Writing like a Responsible Adult — Responsible AI writing requires human judgment to guide models and evaluate outputs, avoiding pandering.
• Measuring the sensitivity of LLM-based structured extraction to prompt, model, and schema choices in clinical discharge summaries — LLM extraction sensitivity varies significantly with schema design and model choice, especially on absence-versus-silence distinctions.
• Content for Content’s Sake — LLM-generated content is subtly altering human language and communication, eroding trust and overwhelming digital systems.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Paper Index on ACL Anthology.