AfroLM vs EthioLLM

A multilingual masked language model pretrained from scratch on 23 African languages using a self-active learning framework, outperforming AfriBERTa, mBERT and XLMR-base on NER and sentiment tasks. Created by Bonaventure Dossou and collaborators, published at SustaiNLP/EMNLP 2022.

EthioLLM is a family of multilingual language models (XLM-RoBERTa and mT5 based) for five Ethiopian languages: Amharic, Ge'ez, Afaan Oromoo, Somali and Tigrinya, plus English. The large variant EthioLLM-l-70K is a fine-tuned XLM-RoBERTa-Large used for masked language modeling and downstream tasks like classification, NER and sentiment. It was released by the EthioNLP collective alongside the Ethiobenchmark evaluation suite.