This, I hope, is close to multi-modal in lingual terms. There's potentially a lot to learn from examining where this works/fails :D
EuroLLM: LLM made in Europe built to support all 24 official EU languages
21–30 of 629 posts
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#22For those curious, the 24 official languages are Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Irish, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish, and Swedish. Maltese, interestingly, is the only Afro-Asiatic derived language. Hungarian, Finnish, and Estonian are the three Uralic languages. All the others ar…
Lithuanian and Latvian are Baltic languages. Nothing to do with Slavic...
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#23looks cool, i hope kagi adds it to the assistant.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#24Aren't all frontier models already able to use all these languages? Support for specific languages doesn't need to be built in, LLMs support all languages because they are trained on multilingual data.
Meh, it depends a lot on the dataset, which are heavily skewed towards the main languages. For example they almost always confuse Czech and Slovak and often swap one for the other in middle of chats
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#25I was thinking the same, why are so many superior models coming from only countries like US and China. And why are European countries not in the list other than France with Mistral. Why are so few companies in India, Japan, South Korea even close to a promising new model like what Chinese companies did ?
"Why" is a fair question but are you surprised? Europe is consistently behind in tech.
Europe has about 1.3 times the population of the USA and about 75% of the GDP yet EU tech output is a very small percentage of US tech output. We are not talking about 70, 50, 30, or even 20%. It's a drop in the bucket.
>The seven largest U.S. tech companies, Alphabet (Google), Amazon, Apple, Meta, Microsoft, Nvidia, and Tesla, are 20 times bigger than Europe’s seven largest, and generate 10 times more revenue.
https://eqtgroup.com/thinq/technology/why-is-europes-tech-in...
"Why" is a good question, but I definitely wouldnt expect significant competition in LLMs from Europe based on the giant tech disparity. Having 1 non-cutting edge model that isn't really competitive is pretty much what I would expect.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#26Title is missing "(2024)". The 9B model was released last december[0].
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#27For those curious, the 24 official languages are Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Irish, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish, and Swedish. Maltese, interestingly, is the only Afro-Asiatic derived language. Hungarian, Finnish, and Estonian are the three Uralic languages. All the others ar…
Lithuanian and Latvian are Baltic languages. Nothing to do with Slavic...
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#28I was thinking the same, why are so many superior models coming from only countries like US and China. And why are European countries not in the list other than France with Mistral. Why are so few companies in India, Japan, South Korea even close to a promising new model like what Chinese companies did ?
Because training frontier model is expensive and only US and China have capital structure to raise tens of billions of dollars to do it.
being able to train new frontier models is the new equivalent to nuclear capabilities.
i predict at some point countries will get CIA'ed when they publish plans to build a large data center.
Similar to the time when they got CIA'ed when announcing plans for new nuclear plants.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#29For those curious, the 24 official languages are Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Irish, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish, and Swedish. Maltese, interestingly, is the only Afro-Asiatic derived language. Hungarian, Finnish, and Estonian are the three Uralic languages. All the others ar…
Lithuanian and Latvian are Baltic languages. Nothing to do with Slavic...
Balto-Slavic branch divides into Baltic and Slavic language groups so nothing wrong here
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#30Are there any benchmarks that exist for those 24 languages?
dupe of https://news.ycombinator.com/item?id=45733832 which sank to the bottom thanks to HN's invisible hand Oh wait, one's not supposed to notice
It's more like the default is to be ranked near the bottom unless your comment gets traction during the brief window of time it is ranked first for being new. Seeing your comments go splat after that window expires is not some nefarious conspiracy..