TriAgent: Divergence-Aware Multi-Agent Committees for Cost-Efficient Financial Sentiment Analysis

· Source: Computation and Language · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, quick

Summary

TriAgent is a multi-agent committee designed to reduce the high costs of production LLM-based financial sentiment analysis. It stratifies agents by contextual granularity, using a word-level lexicon (VADER), a sentence-level domain transformer (FinBERT), and a cross-sentence reasoner (Qwen2.5, 0.5B-14B-4bit, with Mistral-7B and Phi-3.5-mini checks). A Semantic Divergence Index (SDI) routes queries based on pairwise disagreement. Key findings include a critic plateau where an LLM re-tasked as a critic achieves F1 ~0.87, outperforming a 3-persona vote (F1=0.66). The SDI also enables a Shared Consensus Dictionary for 95% of Chinese queries at F1=0.99 and acts as an LLM-hallucination detector (AUC=0.90). TriAgent achieved a Sharpe ratio of 3.50 in a 20-ticker back-test, significantly surpassing always-FinBERT (1.36) and always-LLM (0.11). At 10M users, it saves \$9.3M/year compared to a GPT-4o-mini baseline.

Key takeaway

For Directors of AI/ML optimizing LLM inference costs in financial sentiment analysis, you should consider implementing a stratified multi-agent committee approach like TriAgent. This method significantly reduces operational expenses, potentially saving \$9.3M/year at 10M users, while improving accuracy and providing robust hallucination detection. Evaluate integrating a Semantic Divergence Index to intelligently route queries and enhance system reliability.

Key insights

Divergence-aware multi-agent committees offer cost-efficient and robust financial sentiment analysis by stratifying contextual granularity.

Principles

Method

TriAgent combines VADER, FinBERT, and Qwen2.5 (0.5B-14B-4bit) with a Semantic Divergence Index (SDI) to measure disagreement and route queries.

In practice

Topics

Best for: CTO, AI Architect, AI Engineer, AI Scientist, Machine Learning Engineer, Director of AI/ML

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computation and Language.