Live data from Hacker News

Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

github.com

111–120 of 241 posts

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#111
I don’t know if this warrants a separate thread here but I have to ask…

How can I realistically get involved the AI development space? I feel left out with what’s going on and living in a bubble where AI is forced into by my employer to make use of it (GitHub Copilot), what is a realistic road map to kinda slowly get into AI development, whatever that means

My background is full stack development in Java and React, albeit development is slow.

I’ve only messed with AI on very application side, created a local chat bot for demo purposes to understand what RAG is about to running models locally. But all of this is very superficial and I feel I’m not in the deep with what AI is about. I get I’m too ‘late’ to be on the side of building the next frontier model and makes no sense, what else can I do?

I know Python, next step is maybe do ‘LLM from scratch”? Or I pick up Google machine learning crash course certificate? Or do recently released Nvidia Certification?

I’m open for suggestions

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#112
post #50

Earlier quoted context omitted.

It's insane how much traffic HF must be pushing out of the door. I routinely download models that are hundreds of gigabytes in size from them. A fantastic service to the sovererign AI community.

My fear is that these large "AI" companies will lobby to have these open source options removed or banned, growing concern. I'm not sure how else to explain how much I enjoy using what HF provides, I religiously browse their site for new and exciting models to try.

ModelScope is the Chinese equivalent of Hugging Face and a good back up. All the open models are Chinese anyways

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#113

Earlier quoted context omitted.

FT had a solid piece a few weeks back: "Why AI start-up Hugging Face turned down a $500mn Nvidia deal" https://giftarticle.ft.com/giftarticle/actions/redeem/9b4eca...

sounds very interesting, but even though it says giftarticle.ft, I got blocked by a paywall.

find the Bypass Paywalls Clean extension. Never worry about a paywall again

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#114

Earlier quoted context omitted.

>Will they ever "sell out"? Oh no, never. Don't worry, the usual investors are very well known for fighting for user autonomy (AMD, Nvidia, Intel,IBM, Qualcomm) They are all very pro consumers and all backers are certainly here for your enjoyment only

These are all big hardware firms, which makes a lot of sense as a classic 'commoditize the complement' play. Not exactly pro-consumer, but not quite anti-consumer either!

heliumtera is being sarcastic.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#115
post #50
post #18

I consider HuggingFace more "Open AI" than OpenAI - one of the few quiet heroes (along with Chinese OSS) helping bring on-premise AI to the masses. I'm old enough to remember when traffic was expensive, so I've no idea how they've managed to offer free hosting for so many models. Hopefully it's backed by a sustainable business model, as the ecosystem would be meaningfully worse without them. We still need good value…

It's insane how much traffic HF must be pushing out of the door. I routinely download models that are hundreds of gigabytes in size from them. A fantastic service to the sovererign AI community.

Bandwidth is not that expensive. The Big 3 clouds just want to milk customers via egress. Look at Hetzner or CloudFlare R2 if you want to get get an idea of commodity bandwidth costs.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#116
post #95

Earlier quoted context omitted.

i am curious, why are your comments always pinned to the top?

HN goes through phases. I remember when patio11 was the star of the hour on here. At another time it was that security guy (can't remember his name). And for those who think it's just organic with all of the upvotes, HN absolutely does have a +/- comment bias for users, and it does automatically feature certain people and suppress others.

> And for those who think it's just organic with all of the upvotes, HN absolutely does have a bias for authors, and it does automatically feature certain people and suppress others.

Exactly.

There are configurable settings for each account, which might be automatically or manually set—I'm not sure–, that control the initial position of a comment in threads, and how long it stays there. There might be a reward system, where comments from high-karma accounts are prioritized over others, and accounts with "strikes", e.g. direct warnings from moderators, are penalized.

The difference in upvotes that account ultimately receives, and thus the impact on the discussion, is quite stark. The more visible a comment is, i.e. the more at the top it is, the more upvotes it can collect, which in turn makes it stay at the top, and so on.

It's safe to assume that certain accounts, such as those of YC staff, mods, or alumni, or tech celebrities like simonw, are given the highest priority.

I've noticed this on my own account. Before being warned for an IMO bullshit reason, my comments started to appear near the middle, and quickly float down to the bottom, whereas before they would usually be at the top for a few minutes. The quality of what I say hasn't changed, though the account's standing, and certainly the community itself, has.

I don't mind, nor particularly care about an arbitrary number. This is a proprietary platform run by a VC firm. It would be silly to expect that they've cracked the code of online discourse, or that their goal is to keep it balanced. The discussions here are better on average than elsewhere because of the community, although that also has been declining over the years.

I still find it jarring that most people would vote on a comment depending on if they agree with it or not, instead of engaging with it intellectually, which often pushes interesting comments to the bottom. This is an unsolved problem here, as much as it is on other platforms.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#117

Earlier quoted context omitted.

Because many of us think simonw has discerning taste on this topic and like to read what he has to say about it, so we upvote his comments.

i don't doubt this. i just find it questionable that one particular poster always gets in the spotlight when AI is the topic - while other conversations in my opinion offer more interesting angles.

Agreed,

I would like to see others, being promoted to the top rather than Simon’s constant shilling for backlinks to his blog every time an AI topic is on the front page.

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#118
post #95

Earlier quoted context omitted.

i am curious, why are your comments always pinned to the top?

HN goes through phases. I remember when patio11 was the star of the hour on here. At another time it was that security guy (can't remember his name). And for those who think it's just organic with all of the upvotes, HN absolutely does have a +/- comment bias for users, and it does automatically feature certain people and suppress others.

the security you mean is probably tptacek (https://news.ycombinator.com/user?id=tptacek)

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#119
post #39

Earlier quoted context omitted.

Why doesn't HF support BitTorrent? I know about hf-torrent and hf_transfer, but those aren't nearly as accessible as a link in the web UI.

> Why doesn't HF support BitTorrent? Harder to track downloads then. Only when clients hit the tracker would they be able to get download states, and forget about private repositories or the "gated" ones that Meta/Facebook does for their "open" models. Still, if vanity metrics wasn't so important, it'd be a great option. I've even thought of creating my own torrent mirror of HF to provide as a public service, as even…

Wouldn’t it still provide massive benefits if they could convince/coerce their most popular downloaded models to move to torrenting?

Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI

#120
post #101

Earlier quoted context omitted.

At a guess that's because my comment attracted more up-votes than the other top-level comments in the thread. I generally try to include something in a comment that's not information already under discussion - in this case that was the link and quote from the original README.

of course your comment attracts more upvotes - it's at the top.

It’s at the top because of upvotes. They don’t have an “if simonw: boost” branch in the code.
Post reply on HN