Text Without Typing

2026-07-10 · Source: The Batch | DeepLearning.AI | AI News & Insights - www.deeplearning.ai · Field: Technology & Digital — Artificial Intelligence & Machine Learning, Robotics & Autonomous Systems, Life Sciences & Biology · Depth: Advanced, short

Summary

Researchers from Meta and collaborating institutions introduced Brain2Qwerty v2, an enhanced non-invasive brain-to-text system that translates brain waves into written language. This updated version processes magnetoencephalography (MEG) recordings, breaking brain activity into characters via a CNN/conformer encoder, converting these into word embeddings using a neural network aligner, and finally correcting sequences with a fine-tuned Qwen3-4B language model. Trained on 90 hours of data from 9 subjects, totaling 22 thousand examples, Brain2Qwerty v2 achieved a 39 percent word error rate, improving upon v1's 43 percent. Performance significantly increased with more training data, reducing character error rates from roughly 50 percent at 20 hours to 25 percent at 90 hours. Notably, training across multiple subjects yielded better results (47.8 percent median word error rate) than individual subject training (66.5 percent).

Key takeaway

For AI Scientists developing brain-computer interfaces, you should consider aggregating data across multiple subjects rather than training individually. This approach significantly improves model performance, as Brain2Qwerty v2 demonstrated a 47.8 percent median word error rate compared to 66.5 percent for single-subject training. Your efforts to scale data collection and integrate diverse brain activity patterns could accelerate progress towards highly accurate, non-invasive communication systems, reducing reliance on risky surgical procedures.

Key insights

Brain2Qwerty v2 translates non-invasive brain activity into text, demonstrating improved performance with increased and multi-subject training data.

Principles

• Multi-subject training improves brain-computer interface performance.
• Increased data reduces error rates in brain activity decoding.
• Non-invasive MEG can decode typing intentions.

Method

Brain2Qwerty v2 uses a CNN/conformer encoder for character embeddings, a neural network aligner for word embeddings, and a fine-tuned Qwen3-4B LLM for sequence correction.

In practice

• Explore multi-subject data aggregation for BCI models.
• Fine-tune LLMs with LoRA adapters for subject-specific corrections.
• Utilize MEG for non-invasive brain activity decoding.

Topics

• Brain-Computer Interfaces
• Magnetoencephalography
• Large Language Models
• Qwen3-4B
• Non-invasive Neurotechnology
• Conformer Networks

Code references

• facebookresearch/brain2qwerty

Best for: AI Scientist, Research Scientist, Machine Learning Engineer

Related on AIssential

• Meta's non-invasive brain-to-text AI is closing the gap with surgical implants — Brain2Qwerty v2 reconstructs sentences from non-invasive brain signals, achieving 39% word error rate by using more data and an asynchronous approach.
• Brain-to-Text Without Surgery — Non-invasive brain-to-text technology, exemplified by Brain2Qwerty v2, is advancing rapidly, enabling communication from brain signals without surgery.
• Meta's Noninvasive Brain–Computer Interface Brain2Qwerty Achieves 61% Accuracy — Meta's Brain2Qwerty v2 significantly advances noninvasive BCI thought-to-text decoding, achieving 61% accuracy by scaling data.
• Is EEG-to-Text Feasible in Real-World Scenarios? An In-Depth Analysis Using a Neuropsychology-Inspired Benchmark — New research demonstrates teacher-forcing-free EEG-to-Text decoding is feasible by addressing EEG instability with a novel benchmark.
• Meta's brain-reading AI leaves letters behind — Meta's Brain2Qwerty v2 decodes full sentences from non-invasive brain scans, nearing surgical accuracy for communication.
• Accurate Decoding of Natural Sentences from Non-Invasive Brain Recordings - AI at Meta — Non-invasive brain-to-text decoding can achieve high accuracy by scaling data and integrating advanced AI techniques.

See Counsel's argued verdicts on the open AI decisions leaders are weighing →

Open in AIssential →

Editorial summary, takeaway, and curation by AIssential. Original article published by The Batch | DeepLearning.AI | AI News & Insights - www.deeplearning.ai.