Great job, Thank you.
We support your work and offer backup and distribution. Here a copy just in case: https://hugston.com/uploads/llm_models/EuroLLM-22B-Instruct-...
EuroLLM: LLM made in Europe built to support all 24 official EU languages
291–300 of 629 posts
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#292I was thinking the same, why are so many superior models coming from only countries like US and China. And why are European countries not in the list other than France with Mistral. Why are so few companies in India, Japan, South Korea even close to a promising new model like what Chinese companies did ?
Because the value of these models is (actually) yet to be proven. Why saturate the market with something that we already have at least one of and others are selling as a service? No model provider (including the "big ones" like OpenAI) has been able to produce a viable business case. They're all literally running on government deals and investor money.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#293Earlier quoted context omitted.
Tomorrow there are elections in the Netherlands, and two parties are proposing adding Frysian to that list: https://neerlandistiek.nl/2025/10/kies-voor-taal/ Best get to retraining those models.
Each EU country nominates one official language for the EU, otherwise we'd have Catalan, Breton, Kashubian and many more.
Is English a legacy official language then from the time the UK was a member (I‘m guessing Ireland nominated Irish instead of English). Aside it feels very un-EU to push this limitation, as I was under the assumption that EU was all about celebrating (European) diversity.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#294Aren't all frontier models already able to use all these languages? Support for specific languages doesn't need to be built in, LLMs support all languages because they are trained on multilingual data.
No, that's not how training works. It's not just about having an example in a given language, but also how many examples and the ratio of examples compared to other languages. English hugely eclipses any other language on most US models and that's why performance on other languages is subpar compared to performance on english.
There's actually a research showing that llms are more accurate when questions are in Polish: https://arxiv.org/pdf/2503.01996
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#295For those curious, the 24 official languages are Bulgarian, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, German, Greek, Hungarian, Irish, Italian, Latvian, Lithuanian, Maltese, Polish, Portuguese, Romanian, Slovak, Slovenian, Spanish, and Swedish. Maltese, interestingly, is the only Afro-Asiatic derived language. Hungarian, Finnish, and Estonian are the three Uralic languages. All the others ar…
I read, write and speak Maltese, AMA if you are curious about the language.
Is there any dialect of Arabic which you can understand without too much effort?
How much do you consider Maltese its own language (as opposed to a dialect of Arabic)?
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#296[flagged]
[flagged]
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#297> It is fully open source and available via Hugging Face.
This model was released in 2024, and I couldn't find any links to the training data - is it just an open weights model?
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#298Earlier quoted context omitted.
Each EU country nominates one official language for the EU, otherwise we'd have Catalan, Breton, Kashubian and many more.
Is English a legacy official language then from the time the UK was a member (I‘m guessing Ireland nominated Irish instead of English). Aside it feels very un-EU to push this limitation, as I was under the assumption that EU was all about celebrating (European) diversity.
Still an official language, thankfully. Officially, because of Cyprus.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#299Earlier quoted context omitted.
Who in their right mind would use this?
I'd use a model trained on a targeted and curated data set over one trained on all the crap on the internet any day.
I keep hearing that LLMs are trained on "Internet crap" but is it true? For instance we know from Anthropic copyright case that they scanned millions of books to make a training set. They certainly use Internet content for training but I'm sure it's curated to a large degree. They don't just scrap random pages and feed into LLM.
Re: EuroLLM: LLM made in Europe built to support all 24 official EU languages
#300Earlier quoted context omitted.
European companies are smaller on average and less likely to go public in general, so market cap comparisons don’t show the whole picture. Growing big is less often seen as a goal than in the US. “Megacaps” aren’t necessarily considered a healthy thing to have.
Yes, and this all but guarantees that Europe will stay behind USA and China in their technology capabilities.
What are these capabilities?
I don't see any sense in which the EU has fewer capabilities. It has, say, a smaller number of businesses with smaller market dominance.
It isnt clear to me what capability the EU would gain by having a monopolist social network, a monopolist search engine, a monopolist advertising trader