The most impressive ML translation tool I've seen so far is DeepL[0]. Sometimes, it manages to translate whole articles without errors. [0]: https://www.deepl.com/translator
Impressive, but there's an easy formula for getting these systems to make mistakes. Just input a sentence with some kind of long distance dependency. For example, DeepL gets agreement right in English to Spanish translations when the two things that agree are close together: I like soup -> COMO sopa They eat soup -> COMEN sopa Impressively, it can even get agreement correct across clause boundaries in many cases. But…
Which boys does she know like cheese?
->
¿A qué chicos sabe que LE gusta el queso? [Should be LES]