221–230 of 362 posts
My money has been on Meta for AGI since they started training people to label data for them (tag your friends!) Between all their properties they have more instrumentation on humans, collecting human behavior trajectories and state action pairs transfer learning and inverse RL than anyone - and it’s not even a close second Specifically and critically I think they likely have the largest egocentric multimodal labeled…
Earlier quoted context omitted.
Perhaps the primary barrier between a person’s desire and their ability to do harm to the world is their need to bring other people in on the scheme. These other people have their own moral systems, incentives, preferences, and priorities. But through most of history, to do massive scale harm you had to convince a large number of people to your evil purpose. Technology in general reduces the number of people an indiv…
This narrative imagines a future where everything is controlled by a single uber-AI. Is that necessarily the case? Today we have lots of separate systems and even the internet-connected devices are pretty autonomous. Maybe the future will remain similarly distributed? It feels like everyone's worried about the runaway AI taking over everything when right now a runaway AI wouldn't even be able to turn off my porch lig…
No it doesn’t
> It feels like everyone's worried about the runaway AI
Not the threat vector I just mentioned
Earlier quoted context omitted.
This narrative imagines a future where everything is controlled by a single uber-AI. Is that necessarily the case? Today we have lots of separate systems and even the internet-connected devices are pretty autonomous. Maybe the future will remain similarly distributed? It feels like everyone's worried about the runaway AI taking over everything when right now a runaway AI wouldn't even be able to turn off my porch lig…
> This narrative imagines a future where everything is controlled by a single uber-AI No it doesn’t > It feels like everyone's worried about the runaway AI Not the threat vector I just mentioned
The actual quote: > "Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit." "responsibly" is a pretty important word there that the hn title leaves out. I'm not really sure how that would be possible with a true general intelligence give the alignment problem - it's not really clear to me there's any responsible way to build a true gen…
Isn't this another example of Commoditizing Your Complement?
Lol, ok. Are they also working on world peace?
Earlier quoted context omitted.
> This narrative imagines a future where everything is controlled by a single uber-AI No it doesn’t > It feels like everyone's worried about the runaway AI Not the threat vector I just mentioned
Please elaborate. How does the runaway AI 'enlist the work of millions of average intelligences without having to convince them of anything' to do something dangerous?
Earlier quoted context omitted.
I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.
Perhaps the primary barrier between a person’s desire and their ability to do harm to the world is their need to bring other people in on the scheme. These other people have their own moral systems, incentives, preferences, and priorities. But through most of history, to do massive scale harm you had to convince a large number of people to your evil purpose. Technology in general reduces the number of people an indiv…
Is it even possible to build an AGI with our current computing paradigms? So far our most advanced neural networks are purpose-built for a task (i.e. ChatGPT for text communication, Dall-E for images).
I worry that we're getting close. I don't think our society is built for it.
Your sentiment isn’t lost on me but there isn’t much evidence the future need be a catastrophe either.
I personally think society isn’t going in a great direction, maybe more intelligent systems will help us.