Live data from Hacker News

Mark Zuckerberg’s new goal is creating artificial general intelligence

theverge.com

291–300 of 362 posts

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#291

If only he had set this goal a year ago, maybe John Carmack wouldn't have quit to work on AGI. https://fortune.com/2022/12/17/john-carmack-leaves-meta-as-i...

More likely Carmack left because meta stopped pushing hard for the metaverse as their future and the lawsuit involving him left a bad taste in everyone’s mouth. Not sure why we’d take his declaration of building AGI seriously when he isn’t an AI researcher but a video game programmer.

Carmack has partnered with Rich Sutton, who is an AI researcher -- and, according to https://www.amii.ca/latest-from-amii/john-carmack-and-rich-s... :

> the principal founder of the field of reinforcement learning.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#292

The actual quote: > "Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit." "responsibly" is a pretty important word there that the hn title leaves out. I'm not really sure how that would be possible with a true general intelligence give the alignment problem - it's not really clear to me there's any responsible way to build a true gen…

I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.

You are also difficult and expensive to deploy. Just getting this instance up and running at a decent level took almost 18 years, and nobody has figured out how to start a second instance of you.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#293

Whatever happened to replacing the US dollar, or creating a metaverse, or curing disease in his children's lifetime? The guy has all the focus of a disco ball.

The "copy or buy what seems to be the next big thing" has worked extremely well for Facebook. Yes, they failed to copy twitter and bitcoin and metaverse didn't seem to take off, but copying the idea of messaging-as-a-social-network was a huge success when they split out facebook messaging into its own app. Similarly buying instagram and whatsapp was hugely succesful, not to mention copying reels/stories from snapchat.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#294

My money has been on Meta for AGI since they started training people to label data for them (tag your friends!) Between all their properties they have more instrumentation on humans, collecting human behavior trajectories and state action pairs transfer learning and inverse RL than anyone - and it’s not even a close second Specifically and critically I think they likely have the largest egocentric multimodal labeled…

The quality of the data matters a lot. Textbooks, scientific papers, etc… are substantially better for training smart and capable LLMs than random social chit-chat. Google and Microsoft both have a lot of corporate info, including source repositories they can legally use. Google has Google Books, Maps, and YouTube. Microsoft has Azure, GitHub, LinkedIn, etc… Facebook has… what? Instagram? Your crazy aunt screaming ab…

Not to mention bot spam. Google and Microsoft have a better idea of their data's provenance than Meta or Reddit.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#295

The actual quote: > "Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit." "responsibly" is a pretty important word there that the hn title leaves out. I'm not really sure how that would be possible with a true general intelligence give the alignment problem - it's not really clear to me there's any responsible way to build a true gen…

I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.

> I am not particularly dangerous.

No need to speak so lowly of yourself. You're far better than that.

You are human. You are a great destructive force. Maybe you just don't see how metal you really are because you're comparing yourself to pros. You take many lives by crushing creatures that enter your home. Creatures that are venomous and grotesque. You eat the flesh of organisms which your species have pumped full of artificial nutrients to make them taste better, specifically cultivating these creatures that were once small in population to one larger than your own, just so you can eat them with bones that grow out of your mouth. But first you throw them into the freezing cold, you then ignite them on fire, and to top it off you cover their flesh in poisons and psychoactive chemicals and just because, some fucking rocks. You might even enjoy the flesh of a particular organism who has a defense mechanism that tricks your brain into thinking your body is on fire, but think "not only is this fine, I fucking want more. Burn baby burn." After processing all this you expel poisonous gasses and expunge toxic waste. You are metal as fuck. How dangerous you are just is a matter of perspective.

And let's be real, if you wanted to be more dangerous, you very well could be. If you are not dangerous, it is not because you can't be, it is because you choose not to be. There is a big difference.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#296

Earlier quoted context omitted.

I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.

There are many other “general intelligences” walking the planet who _are_ extremely dangerous. So it doesn’t need all AGIs to be dangerous for this to be a significant problem, just one is enough.

Idk, we have guns, knives, and fucking nuclear weapons. Humans are pretty dangerous. Very few creatures have weapons other than the ones god gave them. I'm not sure why all the responses here are just accepting of the claim when humans literally took control of an entire planet and routinely kill creatures that were designed to kill, with knives built into them. If you're not dangerous, it's because (thank god) you choose not to be.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#299

Earlier quoted context omitted.

I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.

I don't think you're looking honestly at yourself... Look at all the harm caused by humans! It's more or less all of it! You might not be uniquely dangerous, but "general intelligence with an internet connection" describes Bill Gates, Rupert Murdoch, and Elon Musk just as well. These individuals seem at least as dangerous as our current generation of AI. (Or do they? I'm not sure I agree with myself here...) Worth co…

Yeah I'm really impressed about the lack of self awareness in these comments. People are incredibly dangerous. There's a reason we took control of the planet. Even any single given human is incredibly dangerous and can kill many others (human or non human, and we routinely kill non humans). You can go pick up a gun and just start shooting people. You could go grab a knife and stab dozens in the street. You could easily build explosives. Hell, you could throw fucking buckets of sharp metal objects on a freeway and kill hundreds directly and indirectly. Our intelligence and biology has provided us with many means to create or obtain force multipliers.

I'm really glad the vast majority of humans have decided not to be particularly dangerous (at least to other humans). To think we aren't dangerous is just incredibly naive.

A big reason we aren't is because ingrained into our biology is a literal mechanism to not want to harm others. There's definitely ways to bypass these mechanisms and there are definitely faulty or poorly functioning ones out there, but most humans have it. Oddly this might even be the most dangerous thing we do too, because the definition of a coalition is that the utility is higher than the utility of each individual component.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#300

The actual quote: > "Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit." "responsibly" is a pretty important word there that the hn title leaves out. I'm not really sure how that would be possible with a true general intelligence give the alignment problem - it's not really clear to me there's any responsible way to build a true gen…

I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.

You are very costly don't scale well and "whiny". General Intelligence need not have free/independent will, and even latest Nvidia ** is much cheaper than a single employee anywhere in world considering it works 24/7 and is trained at same level as everybody else in 1st minute.
Post reply on HN