#356 The Forecast for Time Series Forecasts with Rami Krispin, Senior Manager of Data Science at Apple

· Source: DataFramed · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Data Science & Analytics, Software Development & Engineering · Depth: Advanced, extended

Summary

Rami Krispin, Senior Director of Data Science and Engineering at Apple Finance, discusses the evolution and scaling of time series forecasting, particularly with the emergence of time series foundation models. Traditional methods, like ARIMA and Holt-Winters, struggle with the exponential growth of data from sources like electronic devices and retail SKUs, necessitating a shift towards machine learning and foundation models. These new models, exemplified by Amazon's Chronos and Salesforce's Moirai, are trained on vast datasets to handle diverse use cases at scale, enabling businesses like Walmart to optimize inventory and capacity planning for hundreds of thousands of products. Krispin emphasizes the critical role of feature engineering in business forecasting, the importance of backtesting for model selection and stability, and the need for robust risk management and transparent communication of forecast uncertainty to stakeholders, especially in critical applications like energy capacity planning.

Key takeaway

For Data Scientists and MLOps Engineers building forecasting systems, you should embrace time series foundation models to handle large-scale data, but critically combine them with rigorous backtesting and feature engineering. Prioritize transparent communication of forecast uncertainty and model limitations to business stakeholders to build trust and ensure informed decision-making, especially for high-stakes applications like energy capacity planning.

Key insights

Time series foundation models enable scalable forecasting for massive datasets, moving beyond traditional methods.

Principles

Method

The workflow for production forecasting involves data pipeline building, model experimentation with backtesting, model deployment, and continuous monitoring for data drift and accuracy degradation.

In practice

Topics

Best for: Data Scientist, MLOps Engineer, Director of AI/ML

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by DataFramed.