Merit or networks? What decides where research is published

2026-06-02 · Source: Artificial Intelligence · Field: Science & Research — Research Methodology & Innovation, Artificial Intelligence & Machine Learning, Economic Analysis & Policy · Depth: Expert, quick

Summary

A new study investigates the factors determining where research is published, moving beyond the traditional merit-versus-networks debate. It introduces a novel approach using a discipline-trained LLM evaluator to score a paper's idea quality directly from its text before publication, without author names or outcomes. Focusing on 6,208 economics working papers, the research combines this text-legible idea-quality score with execution quality, a connection index, an author-ability index, and an off-the-shelf language-model text score. The findings indicate that execution quality establishes a meritocratic floor, while idea quality grades intermediate prestige levels. Connections primarily influence placement at the most selective journals, acting as a favoritism ceiling. This advantage operates through connected authors writing higher-scoring papers and their papers being more likely to place better at equal scores, though this benefit is bounded.

Key takeaway

For research scientists evaluating publication strategies, this study reveals that robust execution and strong idea quality are fundamental for journal placement. While merit establishes a baseline and grades most prestige levels, you should recognize that author networks significantly influence access to the most selective journals. Focus on producing high-quality work, but be aware of the bounded, additive advantage connections provide at the apex of academic publishing.

Key insights

Scientific publishing outcomes are determined by a complex interplay of merit (idea and execution quality) and author networks.

Principles

• Execution quality forms a meritocratic base for publication.
• Connections primarily influence placement in top-tier journals.
• Idea quality, measurable pre-publication, grades prestige levels.

Method

A discipline-trained LLM evaluates pre-publication idea quality from text, combined with execution quality, connection, author-ability, and language-model text scores to estimate journal placement.

In practice

• LLM evaluators can gauge pre-publication idea quality.
• Multi-factor models can analyze publishing outcomes.
• Recognize network effects in top-tier journal submissions.

Topics

• Scientific Publishing
• LLM Evaluators
• Research Quality
• Academic Networks
• Economics Research
• Meritocracy

Best for: AI Scientist, Research Scientist, AI Ethicist

Related on AIssential

• I’m Running a Controlled Experiment on AI Citation Patterns. Here’s the Design. — Domain authority may measurably influence AI citation rates, impacting content visibility.
• How to win a best paper award — Impactful research stems from good taste, collaboration, rigorous execution, and clear communication, with luck playing a significant role.
• [D] Saw this papaer from ICLR with scores 2,2,2,4 and got accepted, HOW — Area Chair overrides in peer review can lead to controversial paper acceptance/rejection decisions, especially with low reviewer scores.
• Slop is making me feel disconnected from AI Research [D] — The proliferation of low-quality AI research, driven by systemic pressures and AI tools, is eroding research integrity and visibility.
• SciPaths: Forecasting Pathways to Scientific Discovery — Forecasting scientific discovery requires identifying specific enabling contributions and their prior-work groundings, a task current LLMs struggle with.
• David W. Hogg on why we do astrophysics (in the face of LLMs and the lack of clinical value) — Hogg's paper challenges conventional views on LLM intelligence, academic publication, and the core motivations behind scientific research.

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.