EN/FR ↔ Swahili NMT Dataset
Contribute language resources for machine translation to and from Swahili.

Context
RHOpenLabs develops Kitabu, a platform that could benefit from a machine translation module between English, French and Swahili. However, every neural translation system depends on parallel corpora: texts aligned sentence by sentence in both languages, from which the model learns.
For African languages such as Swahili, these corpora are scarce, heterogeneous and of uneven quality: misaligned segments, mixed languages, duplicates. A model trained on such data reproduces its flaws. Before any model could be considered, reliable parallel data was therefore needed.
IMG-NMT-01 · CONTEXT
EN/FR ↔ Swahili NMT Dataset — context
Kitabu could integrate a translation module.
Problem
How can parallel data be selected, prepared and structured reliably enough to experiment with translation between English, French and Swahili?
Solution
A three-stage research effort: comparison of pretrained models and selection of M2M100-418M, assessment of available corpora, then data preparation and partial fine-tuning experiments. These experiments revealed data-quality issues incompatible with production use. In agreement with the company, the project was redirected towards building and publishing an EN/FR ↔ Swahili dataset on Hugging Face.
IMG-NMT-02 · SOLUTION
EN/FR ↔ Swahili NMT Dataset — solution
Scarce, uneven corpora.
Contribution
Research internship at RHOpenLabs. I led the model comparison, built the data preparation pipeline, ran the M2M100-418M experiments, then assembled, documented and published the dataset.
Pipeline steps
- Languages and translation directions are defined.
- Available corpora are explored and compared.
- Formats are converted, notably from Moses to JSONL.
- Each segment's language is identified and unsuitable segments are filtered out.
- Data is cleaned and deduplicated, and alignment is checked.
- The dataset serves as the basis for M2M100-418M experiments.
- It is documented and published on Hugging Face.
Architecture
Each source corpus is first inspected and converted into a common format. Its segments then pass through successive filters: language identification, cleaning, deduplication and alignment checks. Only pairs that pass every stage enter the final dataset, which feeds the experiments and is then published.
IMG-NMT-03 · ARCHITECTURE
EN/FR ↔ Swahili NMT Dataset — overall architecture
Corpora are inspected and converted.
Stack
Python, pandas, PyTorch, Hugging Face Transformers, M2M100-418M, Moses / JSONL, Google Colab.
Benefits
- A reusable parallel resource enriches the Swahili ecosystem.
- The project shows that data quality determines translation quality.
- Experimental limits are documented honestly, without claiming a production-ready model.
- The dataset paves the way for future work on African languages.
Links
huggingface.co/datasets/Johannna-Bell827/fr-sw-en-sw-translation
This case study distinguishes the overall project scope from my personal contribution. No undocumented result or metric is presented.