RMISC: A Large-scale Real-world Multivariate Corpus for Time Series Foundation Models

· Source: Artificial Intelligence · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, quick

Summary

The RMISC corpus is introduced as a large-scale, high-quality, openly accessible, real-world multivariate time series archive. This corpus comprises approximately 200 datasets and 142 billion time points spanning various domains, addressing the limitations of synthetic data often used for pretraining time series foundation models (TSFMs). Researchers pretrained four advanced TSFMs using univariate, synthetic multivariate, and real-world multivariate data to assess the impact of real-world data on zero-shot generalization. Experimental results consistently demonstrate that incorporating real-world multivariate data significantly enhances the generalization performance for both univariate and multivariate TSFMs, offering crucial insights into developing more robust TSFMs.

Key takeaway

For Machine Learning Engineers developing Time Series Foundation Models, you should prioritize real-world multivariate datasets like RMISC for pretraining. Your models will achieve superior zero-shot generalization compared to those trained solely on synthetic data, especially when facing out-of-distribution challenges. Incorporating such high-quality, diverse real-world data is critical for building robust and adaptable TSFMs.

Key insights

Pretraining time series foundation models with real-world multivariate data significantly improves zero-shot generalization.

Principles

Method

Pretrain TSFMs on univariate, synthetic multivariate, and real-world multivariate data, then evaluate zero-shot generalization on in-distribution and out-of-distribution benchmarks.

In practice

Topics

Best for: Research Scientist, AI Scientist, Machine Learning Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Artificial Intelligence.