Beginning of July, Meta AI published an outstanding work: No Language Left Behind (NLLB). It presents a new translation model and datasets for 200 languages. This is a wonderful initiative that will definitely benefit many on the planet.

It is also a scientifically dubious work. In this article, I demonstrate that many of Meta AI claims made in NLLB are: unfounded, misleading, and the result of a deeply flawed evaluation. I will also show that, following Meta AI evaluation methodology, it is very easy to obtain even higher numbers than what they have reported.

Continue reading.