Bringing Agentic Search to Earth Observation Data Discovery

· Source: Machine Learning · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, quick

Summary

NASA has developed an agentic search system to simplify the discovery of geoscience datasets and tools within its vast Earth Observation archives. This public service system takes natural-language research queries and returns matching resources, addressing the challenge even domain experts face. The system leverages the NASA Earth Observation Knowledge Graph (NASA-EO-KG) to create NASA-EO-Bench, an open benchmark comprising 47,000 query-dataset pairs, including 21,000 task-based queries. A neural scorer, fine-tuned on NASA-EO-Bench, significantly outperforms cosine and BM25 baselines. Further integration with BM25 through score fusion enhances both Recall@10 and MRR by over 5x. Additionally, a zero-shot agentic reranking stage, requiring no extra training, elevates MRR by 28% on a stratified N=200 subset, highlighting the synergistic role of large language model reasoning with supervised retrieval.

Key takeaway

For Machine Learning Engineers tasked with enhancing complex data discovery, this work demonstrates a powerful hybrid approach. You should consider integrating knowledge graphs with supervised retrieval models, then applying zero-shot agentic reranking to boost performance. This strategy, shown to increase MRR by 28% and Recall@10 by over 5x, offers a clear path to significantly improve the precision and recall of your search systems for specialized datasets like Earth Observation data.

Key insights

Agentic search, amplified by knowledge graphs and LLM reranking, significantly improves Earth Observation data discovery.

Principles

Method

The system combines a neural scorer fine-tuned on NASA-EO-Bench with BM25 via score fusion, then applies zero-shot agentic reranking for enhanced retrieval.

In practice

Topics

Best for: AI Scientist, Research Scientist, Machine Learning Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Machine Learning.