Are there any benchmarks that exist for those 24 languages?
EuroLLM: LLM made in Europe built to support all 24 official EU languages
31–40 of 629 posts
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#32Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#33Earlier quoted context omitted.
Lithuanian and Latvian are Baltic languages. Nothing to do with Slavic...
Balto-Slavic branch divides into Baltic and Slavic language groups so nothing wrong here
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#34For those curious, the 24 official languages are Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Irish, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish, and Swedish. Maltese, interestingly, is the only Afro-Asiatic derived language. Hungarian, Finnish, and Estonian are the three Uralic languages. All the others ar…
I read, write and speak Maltese, AMA if you are curious about the language.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#35For those curious, the 24 official languages are Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Irish, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish, and Swedish. Maltese, interestingly, is the only Afro-Asiatic derived language. Hungarian, Finnish, and Estonian are the three Uralic languages. All the others ar…
Best get to retraining those models.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#36Aren't all frontier models already able to use all these languages? Support for specific languages doesn't need to be built in, LLMs support all languages because they are trained on multilingual data.
Meh, it depends a lot on the dataset, which are heavily skewed towards the main languages. For example they almost always confuse Czech and Slovak and often swap one for the other in middle of chats
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#37Earlier quoted context omitted.
Because training frontier model is expensive and only US and China have capital structure to raise tens of billions of dollars to do it.
being able to train new frontier models is the new equivalent to nuclear capabilities. i predict at some point countries will get CIA'ed when they publish plans to build a large data center. Similar to the time when they got CIA'ed when announcing plans for new nuclear plants.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#38Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#39Aren't all frontier models already able to use all these languages? Support for specific languages doesn't need to be built in, LLMs support all languages because they are trained on multilingual data.
> because they are trained on multilingual data But they were not trained on government-sanctioned homegrown EU data.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#40For those curious, the 24 official languages are Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Irish, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish, and Swedish. Maltese, interestingly, is the only Afro-Asiatic derived language. Hungarian, Finnish, and Estonian are the three Uralic languages. All the others ar…
I read, write and speak Maltese, AMA if you are curious about the language.