Earlier quoted context omitted.
Google Translate simply doesn't use a GPU for translation. It's as easy as that. There is a huge jump in cost associated with using the GPU.
What are you even talking about? You don’t just “use a gpu.” Software doesnt get better by magically throwing it at a gpu. Moreover you can’t just run any old software on a gpu, it has to be built for it. Even then, the gpu is just a speed increase, not a magical make better box. That’s like saying any random text editor would be a better translator if they ran on GPUs. EDIT: google also literally builds its own acce…
Changing Google Translate to use an LLM would become much more expensive for Google.
This is why you see a different cost structure for using "AI". LLM's can't realistically use the CPU for anything serious.