LLMs offer a big advantage over other types of machine translation: they can translate the source text in multiple ways. You can then pick and choose from among those versions to produce the final wording that you like best. Here are five translations of the same passage from a speech by the Japanese prime minister. They were all prepared by GPT-4 from a single prompt: 1. Since becoming Prime Minister, I have visited…
Can't we just sample different "branches" of successive tokens with some mechanism for ensuring diversity like [1] did? This would allow the user to edit a handful of words/phrases/sentences and guide the LLM towards a more idiomatic translation.
This may even give smaller local models a chance.
[1] https://suricrasia.online/blog/making-amulets-with-llama/