Earlier quoted context omitted.
the code is not public, so we can't know. i think it's much more nuanced and certain users' comments might get a preferential treatment, based on factors other than the upvote count - which itself is hidden from us.
> certain users' comments might get a preferential treatment This does not happen. It hasn't even happened when pg made the forum in the first place.
Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
141–150 of 241 posts
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#142Earlier quoted context omitted.
It's a sensible option, even when not everyone can really use it. Linux distros are routinely transfered via torrent, so why not other massive, open-licensed data?
Oh as an option, yeah I agree it makes a ton of sense. I just would expect a very, very small percentage of people to use the torrent over the direct download. With Linux distros, the vast majority of downloads still come from standard web servers. When I download distro images I opt for torrents, but very few people do the same
BitTorrent protocol is IMO better for downloading large files. When I want to download something which exceeds couple GB, and I see two links direct download and BitTorrent, I always click on the torrent.
On paper, HTTP supports range requests to resume partial downloads. IME, it seems modern web browsers neglected to implement it properly. They won’t resume after browser is reopened, or the computer is restarted. Command-line HTTP clients like wget are more reliable, however many web servers these days require some session cookies or one-time query string tokens, and it’s hard to pass that stuff from browser to command-line.
I live in Montenegro, CDN connectivity is not great here. Only a few of them like steam and GOG saturate my 300 megabit/sec download link. Others are much slower, e.g. windows updates download at about 100 megabit/sec. BitTorrent protocol almost always delivers the 300 megabit/sec bandwidth.
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#143Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#144Does local AI have a future? The models are getting ridiculously big and any storage hardware is hoarded by few companies for next 2 years and nvidia has stopped making consumer GPU for this year. It seems to me there is no chance local ML is going to be anywhere out of the toy status comparing to closed source ones in short term
a) to have an idea how much tokens I use and
b) be independent of VC financed token machines and
c) I can use it on a plane/train
Also I never have to wait in a queue, nor will I be told to wait for a few hours. And I get many answers in a second.I don't do full vibe coding with a dozen agents though. I read all the code it produces and guide it where necessary.
Last not least, at some point the VC funded party will be over and when this happens one better knows how to be highly efficient in AI token use.
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#145Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#146> The community will continue to operate fully autonomously and make technical and architectural decisions as usual. Hugging Face is providing the project with long-term sustainable resources, improving the chances of the project to grow and thrive. The project will continue to be 100% open-source and community driven as it is now. I want this to be true, but business interests win out in the end. Llama.cpp is now th…
Llama.cpp is an open source project that anyone can fork as needed, so any "control" over it really only extends to facilitating development of certain features.
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#147Looks like someone tried to type "Gmail" while drunk...
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#148Ollama and webui seem to rapidly lose their charm. Ollama now includes cloud apis which makes no sense as a local.
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#149Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#150Earlier quoted context omitted.
My fear is that these large "AI" companies will lobby to have these open source options removed or banned, growing concern. I'm not sure how else to explain how much I enjoy using what HF provides, I religiously browse their site for new and exciting models to try.
ModelScope is the Chinese equivalent of Hugging Face and a good back up. All the open models are Chinese anyways