An AI image generator for non-English speakers

· Source: ΑΙhub · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Emerging Technologies & Innovation · Depth: Advanced, short

Summary

Researchers at the University of Amsterdam Faculty of Science, in collaboration with Cohere labs, have developed NeoBabel, an open-source AI image generator designed to address digital inequality by supporting six languages: English, French, Dutch, Chinese, Hindi, and Persian. Unlike most English-centric models that rely on translation, NeoBabel directly generates images from multiple languages, preserving linguistic and cultural nuances and outperforming competing models in non-English prompts. The team made their entire research pipeline, including code and an expanded image-label dataset (from 40 million to 124 million pairs), publicly available to foster inclusive AI development. NeoBabel also features improved data labeling using multilingual language models, resulting in a smaller model with fewer parameters. Future applications include multilingual collaborative creative canvases and the long-term goal of expanding to video generation, though this requires more computational power and collaboration.

Key takeaway

NeoBabel is an open-source, multilingual AI image generator supporting six languages (English, French, Dutch, Chinese, Hindi, Persian) that directly generates images, avoiding translation-induced nuance loss. It matches English-centric model performance while outperforming them in other languages, leveraging an expanded 124M image-label dataset and a smaller model footprint. This breakthrough enables truly inclusive, collaborative visual content creation for non-English speakers and fosters open research into culturally specific AI, addressing digital inequality.

Topics

Best for: Computer Vision Engineer, AI Scientist, Research Scientist, AI Researcher, AI Engineer, AI Student

Related on AIssential

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by ΑΙhub.