Live data from Hacker News

Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

github.com

141–150 of 241 posts

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#141

Earlier quoted context omitted.

the code is not public, so we can't know. i think it's much more nuanced and certain users' comments might get a preferential treatment, based on factors other than the upvote count - which itself is hidden from us.

> certain users' comments might get a preferential treatment This does not happen. It hasn't even happened when pg made the forum in the first place.

I thought dang explicitly said it does happen? It certainly happens for stories.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#142

Earlier quoted context omitted.

It's a sensible option, even when not everyone can really use it. Linux distros are routinely transfered via torrent, so why not other massive, open-licensed data?

Oh as an option, yeah I agree it makes a ton of sense. I just would expect a very, very small percentage of people to use the torrent over the direct download. With Linux distros, the vast majority of downloads still come from standard web servers. When I download distro images I opt for torrents, but very few people do the same

> very small percentage of people to use the torrent over the direct download

BitTorrent protocol is IMO better for downloading large files. When I want to download something which exceeds couple GB, and I see two links direct download and BitTorrent, I always click on the torrent.

On paper, HTTP supports range requests to resume partial downloads. IME, it seems modern web browsers neglected to implement it properly. They won’t resume after browser is reopened, or the computer is restarted. Command-line HTTP clients like wget are more reliable, however many web servers these days require some session cookies or one-time query string tokens, and it’s hard to pass that stuff from browser to command-line.

I live in Montenegro, CDN connectivity is not great here. Only a few of them like steam and GOG saturate my 300 megabit/sec download link. Others are much slower, e.g. windows updates download at about 100 megabit/sec. BitTorrent protocol almost always delivers the 300 megabit/sec bandwidth.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#144

Does local AI have a future? The models are getting ridiculously big and any storage hardware is hoarded by few companies for next 2 years and nvidia has stopped making consumer GPU for this year. It seems to me there is no chance local ML is going to be anywhere out of the toy status comparing to closed source ones in short term

I am actually doing now a good part of dev with Qwen3-Coder-Next on an M1 64GB with Qwen Code CLI (a fork of Gemini CLI). I very much like

  a) to have an idea how much tokens I use and 
  b) be independent of VC financed token machines and 
  c) I can use it on a plane/train
Also I never have to wait in a queue, nor will I be told to wait for a few hours. And I get many answers in a second.

I don't do full vibe coding with a dozen agents though. I read all the code it produces and guide it where necessary.

Last not least, at some point the VC funded party will be over and when this happens one better knows how to be highly efficient in AI token use.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#146

> The community will continue to operate fully autonomously and make technical and architectural decisions as usual. Hugging Face is providing the project with long-term sustainable resources, improving the chances of the project to grow and thrive. The project will continue to be 100% open-source and community driven as it is now. I want this to be true, but business interests win out in the end. Llama.cpp is now th…

Llama.cpp is an open source project that anyone can fork as needed, so any "control" over it really only extends to facilitating development of certain features.

In practice, nobody does this, because you then have to keep the fork up to date with upstream plus your changes, and this is an endless amount of work.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#150
post #112

Earlier quoted context omitted.

My fear is that these large "AI" companies will lobby to have these open source options removed or banned, growing concern. I'm not sure how else to explain how much I enjoy using what HF provides, I religiously browse their site for new and exciting models to try.

ModelScope is the Chinese equivalent of Hugging Face and a good back up. All the open models are Chinese anyways

Not true! Mistral is really really good, but I agree that there isn't a single decent open model from the USA.
Post reply on HN