Live data from Hacker News

Apertus – Open Foundation Model for Sovereign AI

apertvs.ai

141–150 of 198 posts

Re: Apertus – Open Foundation Model for Sovereign AI

#141
post #140

From a sovereign AI perspective, how does this compare to Mistral?

It's a different country, and Switzerland is not even in the EU.

True. What France (as an EU member) and Switzerland (not as an EU member) share is a desire for sovereign AI. I am interested how their efforts compare, and how their LLMs thus far compare.

Re: Apertus – Open Foundation Model for Sovereign AI

#142

Earlier quoted context omitted.

Wow, this is a bit obtuse. It is a commonly accepted "fact" right now, outside the US, that the US is not to be trusted (right now), due to some orange guy, and his mates, manipulating markets, running their mouths, doing all kinds of criminal and/or infantile shit. I'd say there is quite a bit of evidence for this all around.

Hardly obtuse. It's good to be specific when making broad claims. The graft of Trump is a big problem, IMO, but the claim was larger than that, as being something about America's system of Law and Justice, and I don't see these as being completely busted (yet) by the Orange Man

Well, the system allowed Trump to be elected, twice, and the system hasn't (so far) prevented him from abusing his office in the ways mentioned. So it's fair to conclude that the US system is the problem, not the symptom called Trump. And if that's the case, it's also fair to conclude that the US is no longer trustworthy, because Trump could happen again.

Re: Apertus – Open Foundation Model for Sovereign AI

#143
post #29
post #20

It's good that there is a movement for open LLMs, but it's not where the battleground is right now . The battleground is local vs service LLMs, and we are losing that battle badly despite all the software being here now and viable, entirely because UX sucks. How many normal people do you know who use "ChatGPT"? A lot, probably. How many even know what "Gemma" is, let alone have downloaded llama.cpp, a GGUF file from…

normal people dont really have the hardware to run local models

Anyone with an M-series Apple computer can run something very competently. Mac Pro users can run 30B class models which is good enough for the vast majority of practical everyday purposes, far better than the original ChatGPT was. Anyone with a gaming computer is in a similar situation. The rest of us can still run stuff, just not as big or as fast.

Re: Apertus – Open Foundation Model for Sovereign AI

#144
post #87
post #29

Earlier quoted context omitted.

normal people dont really have the hardware to run local models

As time goes on, they’re almost certainly will be very capable local models in the long run we (general computer users) aren’t going back to the era of mainframe computing no matter how much OpenAI, Meta or Google would like us to.

We aren't? Are you sure? Where is your email inbox? Where are your backups? Where are your music files? For most people the answer to all those is "someone else's computer".

Re: Apertus – Open Foundation Model for Sovereign AI

#145
post #35
post #20

It's good that there is a movement for open LLMs, but it's not where the battleground is right now . The battleground is local vs service LLMs, and we are losing that battle badly despite all the software being here now and viable, entirely because UX sucks. How many normal people do you know who use "ChatGPT"? A lot, probably. How many even know what "Gemma" is, let alone have downloaded llama.cpp, a GGUF file from…

it's funny because i made this thing (called enough) that aims to make it easy for non-technical people to get up and running with local models quickly, but it is impossible to figure out how to break through the noise. every thread and comment like this breaks my heart a lil bit

Link? You have to tell us if you want to break through the noise!

Re: Apertus – Open Foundation Model for Sovereign AI

#146
post #70
post #28

Earlier quoted context omitted.

It is work using the principles of the art, obviously. But "state of the art" implies the highest state of general availability, not just in terms of access to some product, but of use of the ideas, concepts, methodologies etc. Anthropic and OpenAI have "cutting edge" models; the state of the art is behind the cutting edge. The state of the art is the best open source, open weights model available. More or less by de…

That's an interesting and possibly useful distinction , but it seems unique to you. Spreading it as "We should categorize the AIs this way" would be a good argument. But the way SOTA is generally understood by other users of the language, it refers to exactly the team, technology, & techniques defining the cutting edge in any field, regardless of the whether the technology & techniques are available outside of that t…

Not so much, it turns out.

https://english.stackexchange.com/questions/239963/do-state-...

Re: Apertus – Open Foundation Model for Sovereign AI

#147
post #36
post #20

It's good that there is a movement for open LLMs, but it's not where the battleground is right now . The battleground is local vs service LLMs, and we are losing that battle badly despite all the software being here now and viable, entirely because UX sucks. How many normal people do you know who use "ChatGPT"? A lot, probably. How many even know what "Gemma" is, let alone have downloaded llama.cpp, a GGUF file from…

Why do you feel the important part _now_ is where the weights get run? I can see this as a future battleground but access to frontier models (which you cannot run locally) seems a lot more relevant today.

Because the local LLMs available today are already fantastic, and the difference between no LLM and an open weights LLM is much smaller than the gap between an open LLM and a so-called "frontier" model.

It's important that people get used to the idea that your interactions with a language model are a highly personal thing. LLMs can perceive and categorize us in ways we can't even imagine, far more violently than the simple algorithmic feeds which have already corroded public discourse so much. LLMs can control us. LLMs warp the information landscape more radically than even the internet did. Even now you are likely underestimating their role in future society.

The principles of software freedom are becoming existentially important.

Re: Apertus – Open Foundation Model for Sovereign AI

#148
post #96

Earlier quoted context omitted.

> Instead we have a majority of society that wants to see AI fail. Do you talk to regular people? I work out of coffee shops routinely and literally like 90% of laptops have ChatGPT or Claude open. I was shocked at how many of my friends love the silliest of AI features (like Slack bot summarizing your day or your upcoming meetings), and a lot of decks, proposals, SOW's, etc. are (at least in part) generated with AI…

I'm calling yesterday as Peak Height of AI... I was at my daughter's football game, and another father from the club came up to me and asked if I were in IT and knew how AI worked. He then asked if I could help him setup an AI agent to generate passive income. We're at the equivalent of December 2017 for crypto. Hang on to your hats!

It’s rare to find an example in English that demonstrates the difference in meaning between subjunctive and conditional.

Was it a two part question converted into one with a gate at the beginning, or was a general question about occupations and abilities?

Re: Apertus – Open Foundation Model for Sovereign AI

#149
post #59

Earlier quoted context omitted.

> we are losing that battle badly despite all the software being here now and viable, entirely because UX sucks. Yep. I'm an old time Linux sysadmin, but I am COMPLETELY baffled as to what I can or cannot run on my 32GB R9700 with 128GB main CPU memory. If I want something Claude or Codex like what do I use that would be useful? If I want a chat system, what do I use? Images--apparently ComfyUI for setup but after th…

these days, even completely mainstream distros (Fedora here) include ollama, which leverages a wide range of hardware and range of models. (it's generally useful to install a more recent ollama, though.) there are free coding harnesses too.

ollama is just a wrapper around llama.cpp, and a pretty janky one at that. You're much better off using it directly.

Re: Apertus – Open Foundation Model for Sovereign AI

#150
post #59
post #20

It's good that there is a movement for open LLMs, but it's not where the battleground is right now . The battleground is local vs service LLMs, and we are losing that battle badly despite all the software being here now and viable, entirely because UX sucks. How many normal people do you know who use "ChatGPT"? A lot, probably. How many even know what "Gemma" is, let alone have downloaded llama.cpp, a GGUF file from…

> we are losing that battle badly despite all the software being here now and viable, entirely because UX sucks. Yep. I'm an old time Linux sysadmin, but I am COMPLETELY baffled as to what I can or cannot run on my 32GB R9700 with 128GB main CPU memory. If I want something Claude or Codex like what do I use that would be useful? If I want a chat system, what do I use? Images--apparently ComfyUI for setup but after th…

For coding, Qwen3.6-27B with MTP should fit in 32GB with almost full context length for Unsloth's 5-bit quantization. That's my preferred choice for a local coding agent on similar hardware: the quality delta compared to a MoE model is IMO worth the extra wait. (And I haven't found a model with 70B-120B parameters that works better for coding.) For general chat, maybe gpt-oss-120b? It should have more general knowledge than a 30B-class model; I've used it to suggest itineraries for trips and to review the completeness of small requests for proposals.

I don't have recommendations for images because I haven't played with those.

Post reply on HN