I have more fear of the people running the system than any AI. I also think that AR/VR is more scary than AI. My fear is how poorly rendered AR/VR can be more positive interaction than interactions with the people that surround the observer.
Douglas Hofstadter changes his mind on Deep Learning and AI risk
31–40 of 520 posts
Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#32Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#33" ...In my book," pretty much sums it up. Literally everyone who seems to pontificate on a Chat bot and new Photoshop features has a book and can't seem to help but mention it. Replace "book" with literally anything else and you can see it's completely about ego and money at the end of the day. He's probably getting ready to announce he accepted a position from one of these recently funded AI companies and whatever h…
The book he mentions in this interview, I Am a Strange Loop, isn't some cash grab in response to LLMs - it was written in 2007.
Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#34Hofstadter makes the claim that "these LLMs and other systems like them are all feed-forward". That doesn't sound right to me, but I'm only a casual observer of LLM tech. Is his assertion accurate? FWIW, ChatGPT doesn't think so. :-)
Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#35Do we really lack a good understanding of LLM's and deep nets that we need to be afraid of them? I would love to see this disproved with some open source work on the internals of these models and how they do inference and exactly reason. And why they could possibly never realize an AGI with the current stream of models. Being able to display human level intelligence and creative in confined spaces (be it Chess or Go…
Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#36Do we really lack a good understanding of LLM's and deep nets that we need to be afraid of them? I would love to see this disproved with some open source work on the internals of these models and how they do inference and exactly reason. And why they could possibly never realize an AGI with the current stream of models. Being able to display human level intelligence and creative in confined spaces (be it Chess or Go…
No one has ever been convinced to fly an airplane into a building by a chess board. People have gotten convinced of that by words though. The “attack surface” on human sensibility is just enormous if you’re able to use believably human language.
Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#37I have more fear of the people running the system than any AI. I also think that AR/VR is more scary than AI. My fear is how poorly rendered AR/VR can be more positive interaction than interactions with the people that surround the observer.
If it's a positive interaction, then what is your fear?
Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#38In GEB Hofstadter dismisses the idea that AI could understand / compose / feel music like a human. I thought about this a lot when I started using GPT, especially early on when it demonstrated an ability to explain why things were funny or sad, intrinsically human qualities hitherto insulated from machine
Repeating the words thousands of humans have written about emotion doesn’t meant it feels them. A sociopath could define empathy and still be missing the deeper experience behind the emotion.
Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#39Lets take someone, who is past their prime and interview them on a topic they have never worked on. Then we can mine it for quotes! >"I never imagined that computers would rival, let alone surpass, human intelligence. And in principle, I thought they could rival human intelligence. I didn't see any reason that they couldn't." Yeah, so he got fooled by LLMs and hasnt been burned by it failing to do the most basic logi…
People overly impressed by LLMs haven't spent a lot of time trying to make them actually useful. When you do, you learn that they're talented mimics but still quite limited.
Re: Douglas Hofstadter changes his mind on Deep Learning and AI risk
#40Hofstadter makes the claim that "these LLMs and other systems like them are all feed-forward". That doesn't sound right to me, but I'm only a casual observer of LLM tech. Is his assertion accurate? FWIW, ChatGPT doesn't think so. :-)
Edit: Nope. TIL feed-forward means no loops.