141–150 of 429 posts
Well RIP Stability AI. I love their models and I love how they have changed the entire open source AI ecosystem for the better, but the writing was always on the wall for them given how unprofitable they are. I don't think much of the AI startup scene or socials groups like e/acc would have existed if it weren't for the tech that they just gave away for free. Its interesting how Stability AI and their VC funding have…
Good riddance.
Earlier quoted context omitted.
I don't think it's that SD and LLMs are solutions looking for problems, it's that there are very clear problems to which they provide 90% of a solution and make it impossible to clear the last 10%. They're the new WYSIWYG/low-code. Everyone that doesn't fully understand the problem space thinks they're some ultimate solution that is going to revolutionise everything. People that do are responding with a resounding 'm…
And even a lot of the hentai is fucking worthless for the same reasons! Try generating some kinbaku. It's really hard to get something where all the rope actually connects and interacts sensibly because it doesn't actually know what a knot is. Instead, you end up with M. C. Escher: Fetish Edition.
Earlier quoted context omitted.
Midjourney is the most popular discord channel by far with 19.5M+ members, $200M in revenue in 2023 with 0 external investments and only 40 employees. The problem has nothing to do with commercializing image gen AI and all to do with Emad/Stability having seemingly 0 sensible business plans. Seriously this seemed to be the plan: Step 1: Release SD for free Step 2: ??? Step 3: Profit The vast majority of users couldn'…
>The vast majority of users couldn't be bothered to take the steps necessary to get it running locally so I don't even think the open sourcing philosophy would have been a serious hurdle to wider commercial adoption. The more I think about the AI space the more I realize that open sourcing large models is pointless now. Until you can reasonably buy a rig to run the model there is simply no point in doing this. It's n…
As models advance, they will become - not just larger - but also more efficient. Hardware advances. Large models will run just fine on affordable hardware in just a few years.
Earlier quoted context omitted.
The released image generation models run on consumer GPUs. Even the big LLMs will run on a $3500 Mac with reasonable performance, and the CPU of a dirt cheap machine if you don't care about it being slow, which is sometimes important and sometimes isn't. Also, things like this are in the works: https://news.ycombinator.com/item?id=39794864 Which will put the system RAM of the new 24-channel PC servers in range of the…
The `big' AI models are trillion parameter models. The medium sized models like GPT3 and Grok are 185b and 314b respectively. There is no way for _anyone_ to run these on a sub $50k machine in 2024, and even if you can the token generation speed on CPU is under 0.1 tokens per second.
Earlier quoted context omitted.
Maybe… he certainly was good at taking credit for it. Not course if they stepped in, rebranded something they didn’t make and threw a bunch of AwS GPUs they couldn’t actually afford at it though https://petapixel.com/2023/06/05/so-many-things-dont-add-up-...
So where can I download that thing he took credit for?
Earlier quoted context omitted.
The `big' AI models are trillion parameter models. The medium sized models like GPT3 and Grok are 185b and 314b respectively. There is no way for _anyone_ to run these on a sub $50k machine in 2024, and even if you can the token generation speed on CPU is under 0.1 tokens per second.
ChatGPT is 20B according to Microsoft researchers, also the fact that big AI models are trillion parameter models is mostly speculation, about GPT-4 it was spread by geohot.
The withdrawn paper: https://arxiv.org/abs/2310.17680
The wrong source: https://www.forbes.com/sites/forbestechcouncil/2023/02/17/is...
The discussion: https://www.reddit.com/r/LocalLLaMA/comments/17jrj82/new_mic...
Well RIP Stability AI. I love their models and I love how they have changed the entire open source AI ecosystem for the better, but the writing was always on the wall for them given how unprofitable they are. I don't think much of the AI startup scene or socials groups like e/acc would have existed if it weren't for the tech that they just gave away for free. Its interesting how Stability AI and their VC funding have…
Earlier quoted context omitted.
I don't think it's that SD and LLMs are solutions looking for problems, it's that there are very clear problems to which they provide 90% of a solution and make it impossible to clear the last 10%. They're the new WYSIWYG/low-code. Everyone that doesn't fully understand the problem space thinks they're some ultimate solution that is going to revolutionise everything. People that do are responding with a resounding 'm…
Pretty much what happened with Speech Recognition for 30 years. That last 10% had to be handled manually. Even if you get 90% right, it still means ever second sentence has issues. And as things scale up the costs of all that manual behind the scenes hacking scale up too. We underestimated how many issues involved Ambiguity - where N people see the same thing and have N different interpretations. So you see a whole b…
The underlying reason is that current AI businesses and models are failing to capture any significant economic value. We're going to get there, but it will take some more work. It won't be decades, but a few more years would be helpful
Midjourney is the most popular discord channel by far with 19.5M+ members, $200M in revenue in 2023 with 0 external investments and only 40 employees. The problem has nothing to do with commercializing image gen AI and all to do with Emad/Stability having seemingly 0 sensible business plans. Seriously this seemed to be the plan: Step 1: Release SD for free Step 2: ??? Step 3: Profit The vast majority of users couldn'…
But for the individuals involved, it might also be
Step 2: Leverage fame in AI space for massive VC injection on favorable terms.