Live data from Hacker News

Building a Virtual Machine Inside ChatGPT

engraved.blog

941–947 of 947 posts

Re: Building a Virtual Machine Inside ChatGPT

#945
post #695

Earlier quoted context omitted.

I think I should plan to retire from the internet at some point. When I'm old there will be endless deep fake autonomous agents scamming everyone. Or worse, consensus reality will be impossible to define due to generated fake news.

I think we are really close to a situation Neil Stephenson described in his book "Fall, or Dodge in Hell" where the internet/social media is swarmed with APEs. Bots that spread so much misinformation in various directions about a topic so it becomes impossible to trust anything posted online.

See also: "the maelstrom" in the Starfish Trilogy/Series by Peter Watts.

Re: Building a Virtual Machine Inside ChatGPT

#946

Earlier quoted context omitted.

Strongly disagree. Mathematician Gregory Chaitin said "compression is comprehension", and I think this is exactly correct: something is "more understood" if it can be internally represented or externally reproduced with less information. Based on how transformers are trained to predict the next token, you can view them as powerful compression algorithms [1]. They truly must - and do - understand complex concepts to g…

Well the prompt is there to provide agency isn't it?

Not in any real sense - it just reacts to the prompt, and has no choice in how.

However, if you ductaped a simple goal directed reinforcement learning embodied agent onto a large language model, I think you'd approach something resembling animal-like intelligence. It would have motives, and the means to try to achieve them and adapt to it's environment. There's research in using LLMs for "internal dialog" in robots which is super interesting (https://innermonologue.github.io/)

Post reply on HN