AfroLM vs NileChat-3B

A multilingual masked language model pretrained from scratch on 23 African languages using a self-active learning framework, outperforming AfriBERTa, mBERT and XLMR-base on NER and sentiment tasks. Created by Bonaventure Dossou and collaborators, published at SustaiNLP/EMNLP 2022.

NileChat-3B is a 3B-parameter LLM built on Qwen2.5-3B and adapted for Egyptian and Moroccan communities, handling Egyptian and Moroccan dialectal Arabic in both Arabic script and Arabizi alongside Modern Standard Arabic, French and English. It was trained with controlled synthetic data and translated corpora and outperforms its Qwen2.5-3B baseline on Arabic benchmarks. It was released by the UBC Deep Learning and NLP Lab and accepted at EMNLP 2025.