PolyUQuest: Verifiable Structure-Aware Web RAG over Heterogeneous Graphs
Summary
PolyUQuest is a novel, verifiable, structure-aware web Retrieval-Augmented Generation (RAG) framework designed to overcome the limitations of existing systems that treat web pages as flat text. It constructs a heterogeneous graph integrating hyperlink topology, DOM hierarchy, and entity-relation knowledge across web pages. A two-tier router intelligently dispatches queries to one of three retrieval modes: direct block retrieval, cross-page graph traversal, or multi-hop entity reasoning, based on the query's structural needs. A key feature is its full verifiability, where every cited answer block provides its source page, heading path, and entity links, enabling users to trace claims to their structural evidence. Evaluated on the Hong Kong Polytechnic University's official websites, comprising 4,240 pages, 31,086 DOM blocks, 29,119 entities, and 37,680 relations, PolyUQuest significantly outperforms current RAG systems in answer correctness, coverage, and faithfulness, while also reducing LLM token consumption. It is slated for deployment as a student-facing QA service at PolyU.
Key takeaway
For AI Engineers developing RAG systems over complex, structured web content, PolyUQuest demonstrates that treating web pages as flat text severely limits performance and verifiability. You should explore integrating heterogeneous graphs that unify DOM hierarchy, hyperlink topology, and entity-relation knowledge to significantly improve answer correctness, coverage, and faithfulness. This approach also reduces LLM token consumption and provides critical verifiability, allowing users to trace claims directly to their structural evidence.
Key insights
PolyUQuest enhances RAG by using heterogeneous graphs for structure-aware, verifiable web information retrieval.
Principles
- Integrate web structure (DOM, hyperlinks) into RAG.
- Enable answer verifiability via structural evidence.
- Route queries based on structural complexity.
Method
Construct a heterogeneous graph from web pages, unifying hyperlink topology, DOM hierarchy, and entity-relation knowledge, then use a two-tier router to dispatch queries to specific retrieval modes.
In practice
- Implement graph-based RAG for complex web data.
- Provide source page, heading path, and entity links for verifiability.
- Optimize LLM token use with structure-aware retrieval.
Topics
- Retrieval-Augmented Generation
- Heterogeneous Graphs
- Web Data Structure
- Verifiable AI
- DOM Hierarchy
- LLM Efficiency
Best for: Research Scientist, AI Architect, NLP Engineer, AI Scientist, Machine Learning Engineer, AI Engineer
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.