RMISC: A Large-scale Real-world Multivariate Corpus for Time Series Foundation Models

· Source: Takara TLDR - Daily AI Papers · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics · Depth: Expert, quick

Summary

The RMISC corpus has been established as a large-scale, high-quality, openly accessible, real-world multivariate time series archive. This corpus, comprising around 200 datasets and 142 billion time points across diverse domains, addresses a critical gap in Time Series Foundation Models (TSFMs) development. Current TSFMs are often pretrained on synthetic data, which may not capture complex real-world temporal dynamics. Experiments pretraining four advanced TSFMs on univariate, synthetic multivariate, and real-world multivariate data demonstrated that incorporating real-world multivariate data significantly improves zero-shot generalization performance for both univariate and multivariate TSFMs on standard in-distribution and out-of-distribution benchmarks. This research offers insights into the benefits of real-world data for developing more robust TSFMs.

Key takeaway

For Machine Learning Engineers developing Time Series Foundation Models, you should prioritize incorporating large-scale real-world multivariate datasets like RMISC for pretraining. Relying solely on synthetic data risks suboptimal zero-shot generalization performance. Real-world data, proven to improve benchmark results, yields more robust TSFMs for complex temporal dynamics and diverse applications.

Key insights

Training Time Series Foundation Models (TSFMs) with large-scale real-world multivariate data substantially enhances their zero-shot generalization capabilities.

Principles

Method

Establish RMISC, a large-scale real-world multivariate time series corpus. Pretrain four advanced TSFMs on univariate, synthetic multivariate, and real-world multivariate data, then evaluate zero-shot generalization on in-distribution and out-of-distribution benchmarks.

In practice

Topics

Best for: Research Scientist, AI Scientist, Machine Learning Engineer

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Takara TLDR - Daily AI Papers.