GeoChrono: Benchmarking and Rethinking Long-Term Temporal Understanding in Remote Sensing

· Source: Computer Vision and Pattern Recognition · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Computer Vision & Pattern Recognition · Depth: Expert, quick

Summary

GeoChrono introduces ChronoBench, a multidimensional benchmark designed to systematically evaluate long-term temporal understanding in remote sensing. ChronoBench decomposes this task into four cognitive levels: Land Cover Perception, Temporal Recognition, Long-Term Memory, and Spatio-Temporal Reasoning, comprising 12 sub-tasks and 17,689 rigorously validated QA pairs. Evaluations reveal that mainstream MLLMs significantly underperform human experts, with Long-Term Memory identified as the most critical bottleneck. To address this, GeoChrono proposes an MLLM with enhanced capabilities, leveraging a Temporal Trajectory Encoder (TempEnc) for per-location land cover evolution modeling and a Coarse-to-Fine Token Compressor (C2FComp) to adaptively preserve dynamic regions while compressing static backgrounds. Supported by ChronoInstruct, a 104K-sample instruction-tuning dataset, GeoChrono achieves state-of-the-art performance on ChronoBench, surpassing leading commercial MLLMs by over 20%. C2FComp alone reduces visual tokens by over 56% while retaining 94.6% of GeoChrono's performance.

Key takeaway

For Machine Learning Engineers developing remote sensing models, GeoChrono and ChronoBench highlight the critical need to improve long-term temporal understanding, especially memory capabilities. You should consider integrating architectural components like temporal trajectory encoders and adaptive token compressors into your models. This approach can significantly enhance performance and efficiency in tracking geographic evolution, as demonstrated by GeoChrono's over 20% improvement on ChronoBench.

Key insights

Long-term temporal understanding in remote sensing requires systematic evaluation and specialized MLLM architectures.

Principles

Method

GeoChrono uses a Temporal Trajectory Encoder for per-location land cover evolution and a Coarse-to-Fine Token Compressor for adaptive token preservation.

In practice

Topics

Code references

Best for: Research Scientist, AI Scientist, Machine Learning Engineer, Computer Vision Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Computer Vision and Pattern Recognition.