Falcon-Emirati-7B Emirati Dialect Model Released
Understand the story
On October 6, 2026, the Hugging Face blog (first-hand news) announced the release of the Falcon-Emirati-7B model, jointly released by Hugging Face and its release partners. The model is fine-tuned from the Falcon-H1-Arabic 7B variant and is specifically designed to understand and generate the Emirati Arabic dialect. According to the blog, the model uses a hybrid architecture with Mamba and Transformer attention in parallel, and its training data includes Emirati dialect web data, Modern Standard Arabic (MSA) data related to Emirati culture, and synthetic data constrained by dictionaries and style rules. The model supports context windows of up to 128K/256K tokens. No further developments have been reported so far.
AI overview of reporting · Updated 11 days ago
Reporting timeline
Explore different aspects of the story through its reporting.
- Hugging Face BlogFalcon-Emirati: When an LLM Learns the Dialect, the Culture, and the Nuance
The co-publishers with Hugging Face released Falcon-Emirati-7B, fine-tuned from the Falcon-H1-Arabic 7B variant to understand and generate Emirati Arabic dialect. The model uses a hybrid Mamba and Transformer attention architecture, trained on Emirati dialect web data, Emirati-culture MSA data, and synthetic data constrained by lexicon and style rules, with a context window supporting up to 128K/256K tokens.