Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open Euro LLM: Open LLMs for Transparent AI in Europe

openeurollm.eu

Post reply on HN
Print view View original

21–30 of 289 posts

Re: Open Euro LLM: Open LLMs for Transparent AI in Europe

#21

Post by troyvit »

jampekka wrote: post #10
simion314 wrote: post #7

Earlier quoted context omitted.

>As a European, that's practically an oxymoron. The more one limits oneself to legally clean data, the worse the models will be. Train an LLM with text books and other legal books, you do not need to train it on pop culture to make it intelligent. For face generations you might need to be more creative, you should not need milions of images stolen from social media to train your model. But makes sense that tech giant…

> Train an LLM with text books and other legal books Without licenses to the books, they are just as illegal (and maybe even moreso) than web content.

If LLM organizations are free to throw billions at hardware they can spare a paltry €50 million for 10 million e-books though, right?

Re: Open Euro LLM: Open LLMs for Transparent AI in Europe

#22

Post by idunnoman1222 »

simion314 wrote: post #7
moffkalast wrote: post #3

> The models will be developed within Europe's robust regulatory framework, ensuring alignment with European values while maintaining technological excellence As a European, that's practically an oxymoron. The more one limits oneself to legally clean data, the worse the models will be. I hate to be pessimistic from the get go, but it doesn't sound like anything useful will be produced by this and we'll have to keep r…

>As a European, that's practically an oxymoron. The more one limits oneself to legally clean data, the worse the models will be. Train an LLM with text books and other legal books, you do not need to train it on pop culture to make it intelligent. For face generations you might need to be more creative, you should not need milions of images stolen from social media to train your model. But makes sense that tech giant…

Open AI fed their original model Anna’s archive for breakfast.

Re: Open Euro LLM: Open LLMs for Transparent AI in Europe

#23

Post by jampekka »

troyvit wrote: post #21
jampekka wrote: post #10

Earlier quoted context omitted.

> Train an LLM with text books and other legal books Without licenses to the books, they are just as illegal (and maybe even moreso) than web content.

If LLM organizations are free to throw billions at hardware they can spare a paltry €50 million for 10 million e-books though, right?

€50 million is about 130% of OpenEuroLLM's budget. And I'm very sceptical publishers will give training licenses for €5 per book. Especially as OpenEuroLLM intends to have an openly available training set.

Copyright sucks.

Re: Open Euro LLM: Open LLMs for Transparent AI in Europe

#25

Post by tesch1 »

esperent wrote: post #19
sarusso wrote: post #8

They allocated €37.4 million [1]. As an European, I truly don’t understand why they keep ignoring that the money required for such projects is at least an order of magnitude more. [1] https://digital-strategy.ec.europa.eu/en/news/pioneering-ai-...

Deepseek's release has shown that there's no great risk in getting left behind. All the info is out there, people with skills are readily available, creating a model that will match whatever current model is considered frontier level is not that hard for an entity like the EU. For everyone here shouting that the EU needs to do something, be a leader, what have they lost so far by choosing to lead in legislation inste…

> lead in legislation

> legislation is kind of the point of a government

As an American, most of this post reads like doublespeak satire. I guess it's not, but just to put a transatlantic pov here.

I'll add a sports metaphor for good measure: in order to become expert football players, we'll get tickets to watch the best teams play.

Re: Open Euro LLM: Open LLMs for Transparent AI in Europe

#26

Post by lnauta »

Fnoord wrote: post #9
moffkalast wrote: post #3

> The models will be developed within Europe's robust regulatory framework, ensuring alignment with European values while maintaining technological excellence As a European, that's practically an oxymoron. The more one limits oneself to legally clean data, the worse the models will be. I hate to be pessimistic from the get go, but it doesn't sound like anything useful will be produced by this and we'll have to keep r…

I've been using Mistral past week due to changes in geopolitics, and Mistral works absolutely great in English. I haven't bothered in my native language yet, but in English it worked great. Better than my first experience with ChatGPT (GPT 3.5), actually.

I've been using mistral for most of January at the same rate as chatgpt before. I decided to pay for it as its per token (in and out) and the bill came yesterday... A whopping 1 cent. Thats probably rounded up.

Re: Open Euro LLM: Open LLMs for Transparent AI in Europe

#27

Post by esperent »

tesch1 wrote: post #25
esperent wrote: post #19

Earlier quoted context omitted.

Deepseek's release has shown that there's no great risk in getting left behind. All the info is out there, people with skills are readily available, creating a model that will match whatever current model is considered frontier level is not that hard for an entity like the EU. For everyone here shouting that the EU needs to do something, be a leader, what have they lost so far by choosing to lead in legislation inste…

> lead in legislation > legislation is kind of the point of a government As an American, most of this post reads like doublespeak satire. I guess it's not, but just to put a transatlantic pov here. I'll add a sports metaphor for good measure: in order to become expert football players, we'll get tickets to watch the best teams play.

> As an American, most of this post reads like doublespeak satire

Yeah, you guys have a lot of brainwashing to get over. I can imagine that you're deeply conditioned to read any outside views on politics as satire.

One kind of brainwashing is the need to reframe everything political into sports metaphors. The EU is not a sports team. It's a political entity. Whatever you might have been taught, these are very different things, with different needs. You can't have meaningful conversations about a political entity via sports metaphors.

Well, maybe in US politics you can. There you have two teams determined to beat the other at all costs. EU politics isn't like that. We are trying to work together, not kill each other.

Re: Open Euro LLM: Open LLMs for Transparent AI in Europe

#29

Post by [deleted] »

tesch1 wrote: post #25
esperent wrote: post #19

Earlier quoted context omitted.

Deepseek's release has shown that there's no great risk in getting left behind. All the info is out there, people with skills are readily available, creating a model that will match whatever current model is considered frontier level is not that hard for an entity like the EU. For everyone here shouting that the EU needs to do something, be a leader, what have they lost so far by choosing to lead in legislation inste…

> lead in legislation > legislation is kind of the point of a government As an American, most of this post reads like doublespeak satire. I guess it's not, but just to put a transatlantic pov here. I'll add a sports metaphor for good measure: in order to become expert football players, we'll get tickets to watch the best teams play.

[deleted]

Re: Open Euro LLM: Open LLMs for Transparent AI in Europe

#30

Post by FanaHOVA »

jpdus wrote: post #13

As someone who is in general skeptical of programs like this (and an European) there are 2 remarkable / timely things about this: - This project doesn't just allocate money to universities or one large company, but includes top research institutions as well as startups and GPU time on supercomputing clusters. The participants are very well connected (e.g. also supported by HF, Together and the likes with European roo…

The problem is that: - These are not really super computing cluster in LLM terms. Leonardo is a 250 PFlops cluster. That is really not much at all. - If people in charge of this project actually believe R1 costs $5.5M to build from scratch, it's already over.
Post reply on HN