Huggingface is the silent GOAT of the AI space, such a great community and platform
Truly amazing that they've managed to build an open and profitable platform without shady practices
Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
11–20 of 241 posts
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#12I'm regularly amazed that HuggingFace is able to make money. It does so much good for the world. How solid is its business model? Is it long-term viable? Will they ever "sell out"?
I once tried hugging face because I wanted I worked through some tutorial. They wanted my credit card details during the registration as far as I remember. After a month they invoiced me some amount of money and I had no idea what it was. To be honest, I don't understand what exactly they do and what services I was paying for, but I cancelled my account and never touched it again. For me that was a totally intransparent process.
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#13As someone who's been in the "AI" space for a while its strange how Hugging Face went from one of the biggest name to not a part of the discussion at all.
I think that's because there's less local AI usage now since there's all kinds of image models by the big labs, so there's really no rush of people self hosting stable diffusion etc anymore the space moved from Consumer to Enterprise pretty fast due to models getting bigger
Today's free models are not really bigger when you account for the use of MoE (with ever increasing sparsity, meaning a smaller fraction of active parameters), and better ways of managing KV caching. You can do useful things with very little RAM/VRAM, it just gets slower and slower the more you try to squeeze it where it doesn't quite belong. But that's not a problem if you're willing to wait for every answer.
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#14This is really great news. I've been one of the strongest supporters of local AI dedicating thousands of hours towards building a framework to enable it. I'm looking forward to seeing what comes of it!
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#15I'm regularly amazed that HuggingFace is able to make money. It does so much good for the world. How solid is its business model? Is it long-term viable? Will they ever "sell out"?
They have paid hosting - https://huggingface.co/enterprise and paid accounts. Also consulting services. Seems like a pretty good foundation to me.
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#16I'm regularly amazed that HuggingFace is able to make money. It does so much good for the world. How solid is its business model? Is it long-term viable? Will they ever "sell out"?
I once tried hugging face because I wanted I worked through some tutorial. They wanted my credit card details during the registration as far as I remember. After a month they invoiced me some amount of money and I had no idea what it was. To be honest, I don't understand what exactly they do and what services I was paying for, but I cancelled my account and never touched it again. For me that was a totally intranspar…
Their pricing seems pretty transparent: https://huggingface.co/pricing
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#17Seems like a great fit - kinda surprised it didn’t happen sooner. I think we are deep in the valley of local AI, but I’d be willing to bet it breaks out in the next 2-3 years. Here’s hoping!
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#18I consider HuggingFace more "Open AI" than OpenAI - one of the few quiet heroes (along with Chinese OSS) helping bring on-premise AI to the masses.
I'm old enough to remember when traffic was expensive, so I've no idea how they've managed to offer free hosting for so many models. Hopefully it's backed by a sustainable business model, as the ecosystem would be meaningfully worse without them.
We still need good value hardware to run Kimi/GLM in-house, but at least we've got the weights and distribution sorted.
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#19Does anyone have a good comparison of HuggingFace/Candle to Burn? I am testing them concurrently, and Burn seems to have an easier-to-use API. (And can use Candle as a backend, which is confusing) When I ask on Reddit or Discord channels, people overwhelmingly recommend Burn, but provide no concrete reasons beyond "Candle is more for inference while Burn is training and inference". This doesn't track, as I've done training on Candle. So, if you've used both: Thoughts?
Re: Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI
#20Huggingface is the silent GOAT of the AI space, such a great community and platform
Truly amazing that they've managed to build an open and profitable platform without shady practices
It’s such a sad state of affairs when shady practices are so normal that finding a company without them is noteworthy.