Persian Pixel: A large-scale synthetic OCR dataset for Persian language
Summary
The Persian Pixel dataset is a new, large-scale synthetic Optical Character Recognition (OCR) dataset designed to overcome the challenges of Persian language OCR, which lags behind Latin-script languages due to script complexity and data scarcity. Comprising over 343,000 high-fidelity image-text pairs, the dataset is generated from a curated seven-million-word Persian corpus using the SynthOCR-Gen rendering framework. It spans sentence, paragraph, and full-page document layouts, faithfully modeling Persian script characteristics like cursive connectivity, contextual glyph shaping, and diacritic placement across seven diverse typefaces, including Naskh and Nastaliq. To bridge the synthetic-to-real domain gap, images are enriched with more than twenty-five stochastic degradation models, emulating realistic document acquisition artifacts such as ink bleed, blur, and noise. This publicly available resource aims to advance research in Persian document analysis and digitization.
Key takeaway
For Machine Learning Engineers developing Persian OCR systems, the Persian Pixel dataset offers a critical resource to overcome data scarcity. You can use this large-scale synthetic dataset to fine-tune transformer-based models like TrOCR and Donut, significantly improving recognition accuracy for complex Perso-Arabic script. Consider implementing curriculum learning, starting with cleaner data and progressing to heavily degraded samples, to build more robust and generalizable OCR solutions for document digitization and historical archives.
Key insights
Synthetic data generation is a scalable, cost-effective solution for OCR in low-resource, complex scripts like Persian.
Principles
- OCR for complex scripts needs shaping-aware rendering.
- Diverse fonts and degradations improve model robustness.
- Multi-granularity data supports varied recognition tasks.
Method
The SynthOCR-Gen pipeline renders text from a curated corpus, applies contextual shaping, uses seven fonts, and adds 25+ stochastic degradations.
In practice
- Fine-tune transformer OCR models (TrOCR, Donut).
- Implement curriculum learning from clean to degraded data.
- Pre-train for domain adaptation with small real datasets.
Topics
- Optical Character Recognition
- Persian Language
- Synthetic Data
- Perso-Arabic Script
- Document Digitization
- TrOCR
- Donut
Code references
Best for: Research Scientist, AI Scientist, Machine Learning Engineer, NLP Engineer
Related on AIssential
See Counsel's argued verdicts on the open AI decisions leaders are weighing →
Editorial summary, takeaway, and curation by AIssential. Original article published by cs.CV updates on arXiv.org.