Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

github.com

Post reply on HN
Print view View original

221–230 of 241 posts

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#221

Post by [deleted] »

imiric wrote: post #218
Eisenstein wrote: post #215

Earlier quoted context omitted.

There is a saying that if everyone you encounter seems to be unreasonable, maybe it isn't the other people that are being unreasonable. This isn't to say that social media is fair, or that people vote properly or that any ranking system based on agreement by readers is a good one. However, generally when you are getting negativity communicated to you and you are seeing consistently poor results around actions you tak…

How are you getting persecution complex from what I said? If anything, your comment might be feeding that delusion. :) My point is that HN definitely has certain weights associated with accounts, which control the karma, visibility, and ultimately discussion of certain topics. This problem doesn't affect only negativity or downvotes, but upvotes as well. The most upvoted comments are not necessarily of the highest qu…

[deleted]

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#222

Post by culi »

cpburns2009 wrote: post #208
culi wrote: post #188

Earlier quoted context omitted.

Your electricity is free?

If you have the hardware to run expensive models, is the cost of electricity much of a factor? According to Google, the average price in the Silicon Valley Area is $0.448 per kWh. An RTX 5090 costs about $4,000 and has a peak power consumption of 1000 W. Maxing out that GPU for a whole year would cost $3,925 at that rate. It's not particularly more expensive than that hardware itself.

At that point it'd be cheaper to get an expensive subscription to a cloud platform AI product. I understand the case for local LLMs but it seems silly to worry about pricing for cloud-based offerings but not worry about pricing for locally run models. Especially since running it locally can often be more expensive

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#224

Post by Barbing »

embedding-shape wrote: post #47
sowbug wrote: post #39

Earlier quoted context omitted.

Why doesn't HF support BitTorrent? I know about hf-torrent and hf_transfer, but those aren't nearly as accessible as a link in the web UI.

> Why doesn't HF support BitTorrent? Harder to track downloads then. Only when clients hit the tracker would they be able to get download states, and forget about private repositories or the "gated" ones that Meta/Facebook does for their "open" models. Still, if vanity metrics wasn't so important, it'd be a great option. I've even thought of creating my own torrent mirror of HF to provide as a public service, as even…

That would be a very nice service. I think folks might rely on it for a number of reasons, including that we'll want to see how biases changed over time. What got sloppier, shillier...

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#225

Post by thot_experiment »

culi wrote: post #188
Eupolemos wrote: post #163

Earlier quoted context omitted.

Why are you talking price when we are talking local AI? That doesn't make any sense to me. Am I missing something?

Your electricity is free?

for almost the entire year, yes.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#226

Post by car »

noisy_boy wrote: post #207
car wrote: post #186

So great to see my two favorite Open Source AI projects/companies joining forces. Since I don't see it mentioned here, LlamaBarn is an awesome little—but mighty—MacOS menubar program, making access to llama.cpp's great web UI and downloading of tastefully curated models easy as pie. It automatically determines the available model- and context-sizes based on available RAM. https://github.com/ggml-org/LlamaBarn Downloa…

Github is showing me unicorn - is there an Linux equivalent? I have a old Thinkpad with a puny Nvidia GPU, can I hope to find anything useful to run on that?

Building Llama.cpp from source with CUDA enabled should get you pretty far. llama-server has a really good web UI, the latest version supports model switching.

As for models, plenty of GGUF quantized (down to 2-bit) available on HF and modelscope.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#227

Post by llm_nerd »

Eisenstein wrote: post #215
imiric wrote: post #116

Earlier quoted context omitted.

> And for those who think it's just organic with all of the upvotes, HN absolutely does have a bias for authors, and it does automatically feature certain people and suppress others. Exactly. There are configurable settings for each account, which might be automatically or manually set—I'm not sure–, that control the initial position of a comment in threads, and how long it stays there. There might be a reward system…

There is a saying that if everyone you encounter seems to be unreasonable, maybe it isn't the other people that are being unreasonable. This isn't to say that social media is fair, or that people vote properly or that any ranking system based on agreement by readers is a good one. However, generally when you are getting negativity communicated to you and you are seeing consistently poor results around actions you tak…

You seem to be assuming that everything is organic and above board on here. That it's all just user/community stimuli, and if someone flies high well clearly it's great content, from which we can infer the reverse as well.

We don't have the source for HN, nor do we have the obvious bias metadata that the moderators have put in place, but simply paying attention betrays that manipulation mechanisms exist and are heavily utilized.

For instance I clearly have a "bad guy" flag on my account, and frequently see my highly rated comments sorted below literally greyed out comments. Comments older than mine, so it isn't just the normal "well newer comments get a boost", it's just that there is a comment "DEI" in place where some people get a freebie boost and some people get a freebie detriment. It's why often mediocre content and comments by the core group is always floating high.

And let me make it very clear that I do not care. I don't harbour any delusions about some tight community or the like, and HN is not important in my life or my ego. I also know that it's basically a propaganda network for YC (I mean...it's right in the URL), and good for them. It's their site and they can do anything they want with it.

I only commented because some people really think this place is a meritocracy+democracy. That isn't how it works, even if they really want people to think that.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#228

Post by in-silico »

I_am_tiberius wrote: post #12
HanClinto wrote: post #7

I'm regularly amazed that HuggingFace is able to make money. It does so much good for the world. How solid is its business model? Is it long-term viable? Will they ever "sell out"?

I once tried hugging face because I wanted I worked through some tutorial. They wanted my credit card details during the registration as far as I remember. After a month they invoiced me some amount of money and I had no idea what it was. To be honest, I don't understand what exactly they do and what services I was paying for, but I cancelled my account and never touched it again. For me that was a totally intranspar…

Sounds like a personal skill issue

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#229

Post by seanmcdirmid »

BoredomIsFun wrote: post #219
seanmcdirmid wrote: post #217

Earlier quoted context omitted.

Instruct and coder just follow instructions so well though. I guess I’ve just never been able to make mistral work well, I guess.

Qwen3 30B A3B and that big 400+ B Coder were absolutely terrible at editing fiction. I would tell them what to change in the prose and they'd just regurgitate text with no changes.

Did you try asking Gemini what model to use and how to configure/set it up? It has worked wonders for me, ironically (since I’m using a big model to setup smaller local models).

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#230

Post by Eisenstein »

llm_nerd wrote: post #227
Eisenstein wrote: post #215

Earlier quoted context omitted.

There is a saying that if everyone you encounter seems to be unreasonable, maybe it isn't the other people that are being unreasonable. This isn't to say that social media is fair, or that people vote properly or that any ranking system based on agreement by readers is a good one. However, generally when you are getting negativity communicated to you and you are seeing consistently poor results around actions you tak…

You seem to be assuming that everything is organic and above board on here. That it's all just user/community stimuli, and if someone flies high well clearly it's great content, from which we can infer the reverse as well. We don't have the source for HN, nor do we have the obvious bias metadata that the moderators have put in place, but simply paying attention betrays that manipulation mechanisms exist and are heavi…

No one is under the assumption that any social media space is going to be meritocratic or democratic. The assumption is that some percentage of users are manipulating it and the backend and admins are doing the same. It is an attention economy. I don't think anyone is naive about this. My comment was merely a take on the 'the video game controller is broken' excuse that everyone has when they need to cover for their ego. Sometimes the controller is broken, but it almost never is.
Post reply on HN