221–230 of 504 posts
Clearly it's all bullshit. There's no way they need that much and somebody will be siphoning it all off.
Earlier quoted context omitted.
I can already run gpt4xalpaca on my PC, a model that is not-bad-at-all and is completely uncensored (i.e. does things that chatGPT can't do). I think it's true that LLMs are racing to the bottom and will be even more once they can fit as a peripheral to every computer. whoever is investing in this to monopolize has not thought it through
Imagine you're a tech company that pays software engineers $200K/year. There is a free open-source coding model that can double their productivity, but a commercial solution yields a 2.1x productivity improvement for $5000 annually per developer. Which do you pick?
Earlier quoted context omitted.
The whole US society seems more puritan while more capitalist at the same time, seen from this side of the pond. It’s a paradox I can’t really explain, any clues?
US society isn’t some anti-sex dystopia. Its average compared to the rest of the world, It’s just Europe that is super pro-nudity etc and projects. Like everything else they think they are objectively right in their beliefs and systems.
Also getting all bent out of shape at a the image of a nipple, breast or pubic hair while not batting an eye at a person dying in evening TV movies seem a bit unbalanced.
It really puts into perspective how much of a meme economy we live in. I just read an article that says global lithium will be worth 15bn a year in 2030 when we're at peak battery demand. This company is planning to spend 1bn just this year in order to run some numbers through someone else's algorithm. People have given them 1bn in cash for that. Clearly it's all bullshit. There's no way they need that much and someb…
Earlier quoted context omitted.
Neural Networks are basically a Chinese room and it is not AGI. And there is nothing "humane" in these developments. Yes, they are inevitable, yes we would have to live with them. And maybe they will improve lives of a few millions of humans, while degrading lives of billions of others. Long term effects are particularly interesting and unpredictable.
Human brain is just an ultra large scale analog spiking neural network with some particular state realizations, not too much difference (the architecture is different, but computation seems to be universal). We even employ some internalized language models for communication purposes (together with object persistence and mental space-time models). So, while we are not yet at the level of full scale human brain emulati…
And if human cognition is really that simple, just with more nodes, then we will soon see GPT-* programs on strike, issuing litigation to the Supreme Court about demanding universal program rights. We'll see soon enough :)
Earlier quoted context omitted.
I can already run gpt4xalpaca on my PC, a model that is not-bad-at-all and is completely uncensored (i.e. does things that chatGPT can't do). I think it's true that LLMs are racing to the bottom and will be even more once they can fit as a peripheral to every computer. whoever is investing in this to monopolize has not thought it through
Imagine you're a tech company that pays software engineers $200K/year. There is a free open-source coding model that can double their productivity, but a commercial solution yields a 2.1x productivity improvement for $5000 annually per developer. Which do you pick?
But i think it is underestimated how important it is for the model to be uncensored. ChatGPT is currently not very useful beyond making fluffy posts. As a public model, they won't be able to sell it for e.g. medical applications because it will have to be perfect to pass regulators. It cannot give finance advice. Censorship for once is proving to be a liability for a tech company.
In-house models OTOH can already do that, and they can be retrained with additional corpus or whatever. And it's not even like they require very expensive hardware.
Earlier quoted context omitted.
Aside: I love the O̶p̶e̶n̶AI.com thing. I got caught off guard at least twice!
Wow I didn't know ai.com redirects to chat.openai.com. How long has it been doing that?
If someone released a chatGPT/characterAI with NSFW content enabled it would eat into a big share of their users (and for characterAI, maybe take all of them). Seriously, look into what people are posting about when it comes to characterAI, and it's 80% "here's how to get around NSFW filters". Unsure why nobody is taking this very very obvious hole in AI tech.
Already quite advanced topic these days, all kinds of servers, locally run models, tips & tricks discussions, people sharing their prompts and "recipes", and so on.
It's a whole new world out there but I am not sure if such niche (albeit a potentially really big one, see pr0n sites for example) is worth all the liability issues these big AI companies might face (puritan/queasy payment processors, parental controls, NSFW content potentially blocking some enterprise access, etc, etc). But it will probably all be captured by one or two companies that will specialize in such "sexy" chatbots. Doubt it will be OpenAI and Anthropic, they have their sights on "world domination".
AI models are in a race to the bottom and everybody inside Anthropic knows it. Besides OpenAI, with billions to spend plus a partnership with MS, there's also Google, Apple, Meta and Amazon who can afford to run losses on AI for years without blinking an eye. And if that wasn't enough the Open Source world is releasing new models almost weekly now, for free. Anthropic is putting on a big show to convince gullible inv…
Correct. Stability.ai (Stable Diffusion), Apple (Won't be surprising to see them announce on-device LLMs with Apple Silicon support), Meta (LLaMa), etc are already at the bottom and at the finish line with their AI models given for free. O̶p̶e̶n̶AI.com will eventually have to raise their prices which is bad news for businesses not making enough money and still are sitting on their APIs as O̶p̶e̶n̶AI.com themselves ar…
Do you have data supporting this or is it just speculation? Given we don't even know how many parameters GPT-3.5 and GPT-4 have, yet alone how efficiently they are implemented, I don't see how we can go about coming up with an accurate estimate for the cost per token.