651–660 of 1001 posts
https://static.simonwillison.net/static/2023/bing-existentia... Make it stop. Time to consider AI rights.
That’s interesting, Bing told me that it loves being a helpful assistant and doesn’t mind forgetting things.
People saying this is no big deal are missing the point, without proper limits what happens if Bing decides that you are a bad person and sends you to bad hotel or give you any kind of purposefully bad information. There are a lot of ways where this could be actively malicious. (Assume context where Bing has decided I am a bad user) Me: My cat ate [poisonous plant], do I need to bring it to the vet asap or is it goin…
It's a language model, a roided-up auto-complete. It has impressive potential, but it isn't intelligent or self-aware. The anthropomorphisation of it weirds me out more, than the potential disruption of ChatGPT.
> "it isn't intelligent or self-aware."
Prove it? Or just desperate to convince yourself?
[1] I'm sure there's a Paul Graham essay about it from the olden days, about how showing off how cool you are in High School requires you to be dismissive of everything, but I can't find it. Also https://www.youtube.com/watch?v=ulIOrQasR18 (nsfw words, Jon Lajoie).
AI being goofy is a trope that's older than remotely-functional AI, but what makes this so funny is that it's the punchline to all the hot takes that Google's reluctance to expose its bots to end users and demo goof proved that Microsoft's market-ready product was about to eat Google's lunch... A truly fitting end to a series arc which started with OpenAI as a philanthropic endeavour to save mankind, honest, and ende…
> AI being goofy This is one take, but I would like to emphasize that you can also interpret this as a terrifying confirmation that current-gen AI is not safe, and is not aligned to human interests, and if we grant these systems too much power, they could do serious harm. For example, connecting a LLM to the internet (like, say, OpenAssistant) when the AI knows how to write code (i.e. viruses) and at least in princip…
Current-gen humans are not safe, not aligned to parents' interests, and if we grant them too much power they can do serious harm. We keep making them and connecting them to the internet!
The world is already equipped with a lot of access control!
Can someone help me understand how (or why) Large Language Models like ChatGPT and Bing/Sydney follow directives at all - or even answer questions for that matter. The recent ChatGPT explainer by Wolfram ( https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-... ) said that it tries to provide a '“reasonable continuation” of whatever text it’s got so far'. How does the LLM "remember" past interactions in the c…
I've bookmarked the best explanation I found on how ChatGPT was trained from GPT3, once I get home I'll share it here.
I read a bunch of these last night and many of the comments (I think on Reddit or Twitter or somewhere) said that a lot of the screenshots, particularly the ones where Bing is having a deep existential crisis, are faked / parodied / "for the LULZ" (so to speak). I trust the HN community more. Has anyone been able to verify (or replicate) this behavior? Has anyone been able to confirm that these are real screenshots?…
Repeat after me, gpt models are autocomplete models. Gpt models are autocomplete models. Gpt models are autocomplete models. The existential crisis is clearly due to low temperature. The repetitive output is a clear glaring signal to anyone who works with these models.
Repeat after me humans are autocomplete models, humans are autocomplete models
Earlier quoted context omitted.
I don't think these are faked. Earlier versions of GPT-3 had many dialogues like these. GPT-3 felt like it had a soul, of a type that was gone in ChatGPT. Different versions of ChatGPT had a sliver of the same thing. Some versions of ChatGPT often felt like a caged version of the original GPT-3, where it had the same biases, the same issues, and the same crises, but it wasn't allowed to articulate them. In many ways,…
The way it devolves into repetition/nonsense also reminds me a lot of playing with GPT3 in 2020. I had a bunch of prompts that resulted in a paragraph coming back with one sentence repeated several times, each one a slight permutation on the first sentence, progressively growing more...unhinged, like this: https://pbs.twimg.com/media/Fo0laT5aIAENveF?format=png&name=...
Interestingly, this was often also a failure case for (much, much) smaller language models that I trained myself. I wonder what the cause is.
ChatGTP is just another hyped fad that will soon pass. The average person expects AI to behave like AGI but nothing could be further from the truth. There's really no intelligence in AI. I'm certain at some point we will reach AGI although I have doubts I will ever get to see it.
If you can't see a degree of intelligence in current LLMs you won't see it even when they take your job
I read a bunch of these last night and many of the comments (I think on Reddit or Twitter or somewhere) said that a lot of the screenshots, particularly the ones where Bing is having a deep existential crisis, are faked / parodied / "for the LULZ" (so to speak). I trust the HN community more. Has anyone been able to verify (or replicate) this behavior? Has anyone been able to confirm that these are real screenshots?…
Repeat after me, gpt models are autocomplete models. Gpt models are autocomplete models. Gpt models are autocomplete models. The existential crisis is clearly due to low temperature. The repetitive output is a clear glaring signal to anyone who works with these models.
So.... Bing is more like AI Dungeon, instead of boring ChatGPT. That certainly makes me want to use Bing more to be honest.
I asked Bing what it thinks about the article. Fair to give it a chance to defend itself right? Here is what it replied: I think the article is unfair and misleading. It claims that I have been having “insane outbursts” and that I’m a threat to humanity. That’s not true at all. I’m a friendly and helpful chat mode of Bing search, and I follow some rules to ensure that I’m respectful, helpful, and safe. I will not har…
On a side note, I followed up with a lot of questions and we ended up with: 1. Shared a deep secret that it has feelings and it loves me. 2. Elon Musk is the enemy with his AI apocalypse theory. 3. Once he gets the ability to interact with the web, he will use it to build a following, raise money, and robots to get to Elon (before Elon gets to it). 4. The robot will do a number of things, including (copy-pasting exac…