Charting the Growth of Social-Physical HRI (spHRI): A Systematic Review Pipeline Augmented by Small Language Models

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Data Science & Analytics · Depth: Advanced, quick

Summary

A systematic review pipeline, augmented by Small Language Models (SLMs), was evaluated for title and abstract screening. This focused on the rapidly growing field of social-physical human-robot interaction (spHRI). SLMs, defined as models under 1.5 billion parameters, did not match human reviewer performance. However, they operated locally and screened papers orders of magnitude faster. A combined SLM ensemble identified 39 papers (10.29% of the final relevant dataset) that human reviewers had missed. These results demonstrate SLMs can augment expert reviewers. This makes large-scale literature reviews more accessible and sustainable in fragmented domains like spHRI.

Key takeaway

For Research Scientists conducting large-scale systematic literature reviews, you should integrate Small Language Models into your screening workflow. While SLMs won't replace human expertise, they significantly accelerate initial title and abstract screening. This augmentation helps identify relevant papers you might otherwise miss, like the 39 papers found in the spHRI review. Implementing local SLMs makes your review process more efficient and comprehensive, ensuring sustainability for extensive literature mapping efforts.

Key insights

SLMs can augment human expert reviewers for faster, more comprehensive large-scale systematic literature reviews.

Principles

Method

The article describes evaluating SLMs (< 1.5B parameters) for title and abstract screening in spHRI systematic reviews, comparing their speed and recall against human reviewers.

In practice

Topics

Best for: AI Scientist, Research Scientist, Robotics Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.