shiyu-coder / Kronos

· Source: Github Trending: All languages · Field: Finance & Economics — Capital Markets & Investment Management, FinTech & Digital Financial Services · Depth: Advanced, medium

Summary

Kronos is the first open-source foundation model designed for financial market K-line sequences, pre-trained on data from over 45 global exchanges. This family of decoder-only Transformer models addresses the high-noise characteristics of financial data through a two-stage framework. First, a specialized tokenizer quantizes continuous, multi-dimensional K-line data (OHLCV) into hierarchical discrete tokens. Second, a large autoregressive Transformer is pre-trained on these tokens to serve as a unified model for various quantitative tasks. Kronos offers models with varying capacities, including Kronos-mini (4.1M params), Kronos-small (24.7M params), and Kronos-base (102.3M params), all available on Hugging Face Hub, with a larger Kronos-large (499.2M params) also mentioned. The project provides scripts for fine-tuning and a live demo showcasing BTC/USDT forecasting.

Key takeaway

For quantitative analysts and machine learning engineers developing financial forecasting models, Kronos offers a specialized, open-source foundation model for K-line data. You should explore its pre-trained models on Hugging Face and leverage the provided fine-tuning scripts to adapt Kronos to your specific market data and quantitative strategies, potentially enhancing prediction accuracy for diverse financial tasks.

Key insights

Kronos is an open-source foundation model for financial K-line data, using a two-stage tokenization and Transformer architecture.

Principles

Method

Kronos employs a two-stage process: a specialized tokenizer quantizes OHLCV data into hierarchical discrete tokens, followed by pre-training a large autoregressive Transformer on these tokens.

In practice

Topics

Code references

Best for: AI Scientist, Machine Learning Engineer, Data Scientist

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by Github Trending: All languages.