AfroLM vs Lugha-Llama

A multilingual masked language model pretrained from scratch on 23 African languages using a self-active learning framework, outperforming AfriBERTa, mBERT and XLMR-base on NER and sentiment tasks. Created by Bonaventure Dossou and collaborators, published at SustaiNLP/EMNLP 2022.

Lugha-Llama is a Llama-3.1-8B model continually pretrained on the WURA African-language corpus to lift performance on low-resource African languages. It ships in three variants (wura, wura_edu, wura_math) and reaches leading results among similarly sized models on the IrokoBench and AfriQA African-language benchmarks. It was built by researchers at Princeton University.