Are Large Language Models Suitable for Graph Computation? Progress and Prospects
Summary
A comprehensive review explores the suitability of Large Language Models (LLMs) for graph computation, a domain requiring reasoning over structured relationships and algorithmic operations. This analysis introduces a role-based taxonomy, identifying two primary paradigms: LLMs as executors, which directly solve graph tasks from descriptions and instructions, and LLMs as planners, which formulate problems, decompose reasoning steps, and invoke external tools. The review indicates that while LLMs show promise for simple, small-scale graph tasks, their reliability diminishes for large-scale and exactness-demanding computations. The work also summarizes available datasets and outlines four future research directions, bridging a gap in existing surveys that primarily focus on graph learning or graph-language modeling.
Key takeaway
For AI Architects evaluating LLM integration into graph-processing pipelines, recognize that current LLMs excel at planning and decomposing simple graph tasks, but are unreliable for large-scale or exact computations. You should design systems where LLMs orchestrate external, specialized graph tools for complex or precise operations, rather than relying on them for direct execution. Prioritize LLM use for initial problem formulation or small-scale reasoning.
Key insights
LLMs show promise for simple graph tasks but struggle with large-scale, exact graph computation, necessitating role-based integration.
Principles
- LLMs can act as direct graph task executors.
- LLMs can function as problem planners for graphs.
- Reliability decreases with graph scale and exactness needs.
Method
The article provides a comprehensive review of LLMs for graph computation using a role-based taxonomy, identifying "LLMs as executors" and "LLMs as planners" paradigms.
In practice
- Use LLMs for small, simple graph tasks.
- Integrate LLMs as planners for complex graph problems.
- Consider external tools for exact graph execution.
Topics
- Large Language Models
- Graph Computation
- LLM Paradigms
- AI Planning
- Graph Algorithms
- Task Execution
Best for: Research Scientist, AI Scientist, Machine Learning Engineer, AI Architect
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Computation and Language.