21–30 of 55 posts
I have had this question. How much better would common LLMs (Llama, GPTN) be if they were only trained in one language? I have to assume they would perform better, but I might be wrong.
they would perform worse, i promise you
This is Hackernews, I would have expected data, not promises.
Great talking points. These are highly relevant subjects and I'm delighted we in the Nordics are keeping up with current developments. This work is important for preserving our culture. I hope to see this used to generate a customized curriculum for each neurodiverse child so that we can live in a more equitable society.
Great talking points. These are highly relevant subjects and I'm delighted we in the Nordics are keeping up with current developments. This work is important for preserving our culture. I hope to see this used to generate a customized curriculum for each neurodiverse child so that we can live in a more equitable society.
No offense but this reply is giving me such “generated by an LLM” vibes, I’m curious if it is
Earlier quoted context omitted.
Just like adding code to textual models helps the model develop its reasoning capabilities, it seems like adding more languages helps in other areas too. What is needed is more good quality data to train on...
> its reasoning capabilities To be clear, LLMs are not capable of reasoning.
Earlier quoted context omitted.
I don't think they decided that, they included Finish which is completely unrelated to the other nordic languages. If they just picked languages that are related for cross learning including Dutch or German would have made more sense indeed.
Including Finnish was probably just a political choice, since Finland and Sweden are very close politically, much closer than Germany or other areas with more similar languages.
Is there something similar for romance or Germanic languages? And how did they decide that, e.g., German or Dutch would make the model worse?
I don't think they decided that, they included Finish which is completely unrelated to the other nordic languages. If they just picked languages that are related for cross learning including Dutch or German would have made more sense indeed.
Would love to know more about their experience training on AMD GPUs. Was it just as seamless as using Cuda?
They probably got a lot of hand holding from AMD.
AMDs bad rep in AI is mostly due to flaky support of its consumer GPUs.
Is there something similar for romance or Germanic languages? And how did they decide that, e.g., German or Dutch would make the model worse?