vamboai/morena-1.5b-instruct
1B • Updated • 56 • 13
A 1.5B language model trained from scratch for twelve African languages, plus 0.5B and 0.2B versions.
Note Chat, translation and tool calling. The model described in the whitepaper.
Note llama.cpp build of the instruct model: f16, Q8_0, Q4_K_M.
Note Pretrained and mid-trained base. Fine-tuning starting point; best African bpb of every model measured.
Note Pruned and distilled 0.5B; beats every outside model on 11 of 12 languages.
Note Chat fine-tune of the mini.
Note llama.cpp build of the mini.
Note 0.2B trunk for ASR rescoring, keyboards and normalisation.
Note llama.cpp build of the nano.