AUDITFLOW: Executable Symbolic Environments for Structured Financial Reporting Verification
Summary
AuditFlow is a novel graph-grounded multi-agent framework designed to enhance structured financial audit verification, a task challenging for language models due to its reliance on structured evidence. This system constructs a symbolic environment using a static US-GAAP taxonomy graph and a dynamic XBRL filing graph, providing typed tools for fact retrieval, taxonomy traversal, numerical checking, and rule evaluation. AuditFlow employs two junior auditors, each inspecting cases from regulatory and evidentiary perspectives, with a senior auditor resolving discrepancies and initiating further investigation. The framework fuses final reports through evidential aggregation to generate an audit verdict, expected value, evidence trail, and a trustworthiness score. Utilizing GPT-5.5 on a FinAuditing-derived FinMR sample, AuditFlow achieved 82.09% joint audit accuracy, surpassing the strongest baseline by 14.93 points. Crucially, removing its deterministic checks reduced accuracy to 17.91%, underscoring the symbolic environment's indispensable role in verification.
Key takeaway
For AI Engineers developing financial compliance or audit systems, you should integrate symbolic environments and deterministic verification steps to overcome language models' limitations with structured evidence. Your systems will achieve significantly higher accuracy, as demonstrated by AuditFlow's 82.09% performance, by separating adaptive search from verifiable computations. Consider a multi-agent architecture to mimic complex human workflows, enhancing both reliability and the audit trail for regulatory scrutiny.
Key insights
AuditFlow combines adaptive search with deterministic symbolic verification for robust financial audit accuracy.
Principles
- Separate adaptive search from deterministic verification.
- Structured evidence is critical for financial audit correctness.
Method
AuditFlow builds a symbolic environment from US-GAAP and XBRL graphs, exposing typed tools. Junior auditors inspect, senior resolves, then reports are aggregated for a verdict.
In practice
- Integrate deterministic checks for LLM outputs.
- Model audit workflows with multi-agent systems.
Topics
- AuditFlow
- Financial Reporting
- Multi-agent Systems
- Symbolic AI
- XBRL
- US-GAAP Taxonomy
Best for: AI Scientist, Research Scientist, AI Engineer
Related on AIssential
Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.