Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenEuroLLM

openeurollm.eu

Post reply on HN
Print view View original

91–100 of 181 posts

Re: OpenEuroLLM

#91

Post by simongray »

istrice wrote: post #62

I don't fully understand the reactions in the comments. It's an announcement of a project that is starting soon-ish, mostly aimed at recruiting students and getting European talent excited, why would you expect them to deliver a model upon announcing the project? Did you expect OpenAI to release GPT in the press release that announced its creation as a company? Bullshit Silicon Valley startups do big press releases b…

It's something I've noticed that has started happening on this site whenever the EU is mentioned, especially when LLMs/AI is also mentioned or any kind of regulation. Hacker News is also quite biased against academia in general and, IMO, has always been too obsessed with making money.

I don't think it's (just) bots. I think it's the current strain of Silicon Valley arrogance, not unlike what helped create the current political landscape in America.

Re: OpenEuroLLM

#92

Post by kandesbunzler »

anonymousDan wrote: post #52
Argonaut998 wrote: post #23

Earlier quoted context omitted.

It’s par for the course for this union. It’s just comical given the very recent political events.

In what way? What exactly has the US achieved?

Uhhm.. they lead in pretty much everything especially tech related? You redditors are unbearable.

Re: OpenEuroLLM

#93

Post by kandesbunzler »

cyberax wrote: post #26
dkyc wrote: post #3

But can I run it on Gaia-X? This really reads like a parody. Press release, “a consortium of 20 research institutions”, “awarded the STEP (Strategic Technologies for Europe Platform) seal”. Lots of grandiose self-congratulations. All with nothing to run, download or try of course.

Europe is moving at the speed of bureaucracy. It's slow, but inexorable. And honestly, people don't _want_ the European bureaucracy to move fast. Case in point: the USA.

> , people don't _want_ the European bureaucracy to move fast.

I'm a german and yes i would absolutely want it to move faster. And I guess you are an american?

Re: OpenEuroLLM

#94

Post by DocTomoe »

amrrs wrote: post #78

It's funny they don't have Hugging Face as their Partner. Literally, the biggest face of Open LLMs sitting right in Europe, but somehow it's not a partner.

When you are the front runner, you don't associate with the also-ran and the wannabes. They will drag you down, and drown you in their endless discussion and alignment meetings.

Re: OpenEuroLLM

#95

Post by rafram »

woah wrote: post #10

The three goals featured prominently above the fold are: > truly open > including data, documentation, training and testing code, and evaluation metrics; including community involvement > compliant > under EU regulations, OpenEuroLLM will provide a series of transparent and performant LLMs > diverse > for European languages and other socially and economically interesting ones, preserving linguistic and cultural diver…

People on HN complain constantly about "open-source" models not releasing their training data. That's what the second point ("transparent") seems to be alluding to. And that's a bad thing?

Others have responded to your "diversity" point, but making sure to train on adequate amounts of data in all EU languages is valuable, especially because LLMs are so prone to generating convincing BS when working close to the edges of their training set. If this exists, people in Malta are going to want to use it, so better for it to generate good Maltese than gibberish that sort of looks like Maltese, right?

Re: OpenEuroLLM

#96

Post by amarcheschi »

lynx97 wrote: post #90
amarcheschi wrote: post #82

Earlier quoted context omitted.

If you read what is now the first comment, it says something about a project with similar aim and scope that already achieved some of the points

See, "some of the points", thats a pretty typical tactic... Nope, sorry, have seen too much, dont trust the EU anymore.

You said you would be surprised if it delivered something, a similar project delivered[1] and now you're moving the goalpost. And the results of the other projects are quite good [2]. I get that europe feels like a bloated group of countries with nothing in common, but at least sometimes good things come out

[1] https://sites.google.com/view/eurollm/home

[2] https://cdn-uploads.huggingface.co/production/uploads/63f33e...

Re: OpenEuroLLM

#97

Post by cess11 »

MLENG wrote: post #19
throw8383848 wrote: post #16

》under EU regulations, OpenEuroLLM will provide a series of transparent and performant LLMs What EU relulations? It is a moving target, and nobody knows what exactly apply. It would be nice to provide list of regulations with references. And some testing suite or checklist, to verify AI use actually fits regulations. Right now, if I integrate spellchecker into my app, I have no idea if I am breaking any AI EU regulat…

Don't worry, I would be immensely impressed if they even finish a pretraining run for a competitive model. Let alone get to the stage of doing any kind of fine tuning for any kind of purpose.

Here's a summary of what one of the members has done before.

https://www.ai.se/en/ai-labs/natural-language-understanding/...

They've cooperated with a research agency known in part for their Prolog implementation, i.e. they've been at it since the last massive "AI" hype cycle.

Re: OpenEuroLLM

#98

Post by olejorgenb »

mrshu wrote: post #69

It is worth noting there is _another_, completely unrelated project (also) called *EuroLLM* that is also EU funded which not only shares many of the same goals, but has already fulfilled many of them: 1. large multilingual dataset 2. open science approach 3. competitive performance Here is the HF blogpost that introduced it in December 2024 (along with various benchmarks): https://huggingface.co/blog/eurollm-team/eur…

Homepage: https://sites.google.com/view/eurollm

Deliverables:

- A series of models of different sizes for optimal effectiveness and efficiency (1B, 9B and 22B) trained on 4T tokens

- A multimodal model which can process and understand speech or text input

- Full project codebase available to the public with detailed data and model descriptions

I can't find the codebase yet though

Re: OpenEuroLLM

#99

Post by gman83 »

seydor wrote: post #41

> OpenEuroLLM has a total budget of €37.4 million of which €20.6 million comes from the Digital Europe Programme. So on average 1.87 million per participating institution which might amount to funding ~5 PhD students per institution. Not bad for a training program. The project has been awarded the Sovereignity Seal, an EU mark of Excellence before it even started. This is truly in accordance with european values, whe…

Sovereignity Seal -- https://strategic-technologies.europa.eu/investors_en is just a fund for investing in strategic technologies, it's meant for projects that are getting started.

Re: OpenEuroLLM

#100

Post by dagenleg »

ta12653421 wrote: post #75
seydor wrote: post #41

> OpenEuroLLM has a total budget of €37.4 million of which €20.6 million comes from the Digital Europe Programme. So on average 1.87 million per participating institution which might amount to funding ~5 PhD students per institution. Not bad for a training program. The project has been awarded the Sovereignity Seal, an EU mark of Excellence before it even started. This is truly in accordance with european values, whe…

for 1.87m per project, you get in EU rather 15 - 20 people :) (salaries are low here)

At least in France, where they have PhDs which last only 3 years, a years of PhD would cost ~45K EUR in gross salary (granted the student gets around half of that after tax), then let's say ~10K travel and consumables costs, then add up the inevitable 20% overhead costs and now you're looking at around 200K for the shortest possible frugal 3 year PhD.
Post reply on HN