Live data from Hacker News

Mark Zuckerberg’s new goal is creating artificial general intelligence

theverge.com

161–170 of 362 posts

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#161

Can someone provide insight into why there's so much insistence from business that magic happens at scale with LLMs? We're a long way from AGI. The lack of meaningful details in these announcements makes me pessimistic.

LLM scaling laws are pretty well established at this point. They probably won’t hold forever but we aren’t at the breaking point yet.

Some more pressing questions are:

* What new capabilities emerge as the models get better and better at predicting (i.e. loss goes down)?

* How much will it cost to train increasingly large models? And to run inference on them?

* How difficult will it be to find or generate more and more high quality data?

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#162

I love facebook. I hate other big tech companies. Facebook has done far more for software than any other company in the last 15 years. They: 1. Pushed salaries up across the board. Many people are not aware, but facebook was a major driver behind the 500k+ senior engineering pay. 2. Released major open source software: PyTorch, React, GraphQL, React Native. They basically invented modern web development. Facebook is…

Would feel similar if they weren’t the absolute worst in terms of privacy. And if they didn’t buy out the best VR commercial tech and tie it to FB. Can’t use the Quest or Raybans headsets without logging in to the panopticon.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#163
post #143

Earlier quoted context omitted.

I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.

Valid point. I think the difference is speed/cost. There’s a very high cost of anything humans do (we spend time, spend energy, spend money to do things). The very high cost of doing things stops people from doing a lot of things they otherwise might “if it were as easy as pressing a button”. Also, in my experience, the lower the cost of doing something, the less we pay attention to ethics. (See online bullying vs. i…

That's a valid point too.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#164

Isn’t it obvious to anybody paying attention what their actual strategy is? They know they probably won’t “win” a commercial AI race vs OpenAI or Google, and presuming some other company does win the commercial AI market with closed source tech, they may be forced into a multitude of bad outcomes: 1. having to pay out the nose for licensing/SAAS of the winning tech vs shipping a noticeably worse second rate in-house…

So basically, give away a similar product for free so your competition can't compete on price at all.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#165

The actual quote: > "Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit." "responsibly" is a pretty important word there that the hn title leaves out. I'm not really sure how that would be possible with a true general intelligence give the alignment problem - it's not really clear to me there's any responsible way to build a true gen…

What does irresponsibly open sourcing something look like?

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#166
post #97

My money has been on Meta for AGI since they started training people to label data for them (tag your friends!) Between all their properties they have more instrumentation on humans, collecting human behavior trajectories and state action pairs transfer learning and inverse RL than anyone - and it’s not even a close second Specifically and critically I think they likely have the largest egocentric multimodal labeled…

I have always felt Ebay dropped the ball on this with untold amounts of custom, varying quality photos with tons of metadata added by users. Presumably they are working on using this, but I haven't seen anything from them for it.

I would assume that stuff can be scraped though. How much would it cost to set up a bot farm that scrapes ebay live?

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#167

I love facebook. I hate other big tech companies. Facebook has done far more for software than any other company in the last 15 years. They: 1. Pushed salaries up across the board. Many people are not aware, but facebook was a major driver behind the 500k+ senior engineering pay. 2. Released major open source software: PyTorch, React, GraphQL, React Native. They basically invented modern web development. Facebook is…

I think its pretty myopic to only view facebook through the lens of the benefits theyve provided software engineers. Facebook is a pure cancer on society

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#168

Earlier quoted context omitted.

I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.

That's a really great point. General Artificial Intelligence doesn't look like human intelligence. I guess that's the fear: we have never met another general intelligence before. We may as well be about to meet alien intelligence. One that is not constrained by a moral or social framework, and can copy itself at will.

Are other animals on earth not generally intelligent? Dogs octopus, monkeys, dolphins. They have social structures and can problem solve.

Re: Mark Zuckerberg’s new goal is creating artificial general intelligence

#170

The actual quote: > "Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit." "responsibly" is a pretty important word there that the hn title leaves out. I'm not really sure how that would be possible with a true general intelligence give the alignment problem - it's not really clear to me there's any responsible way to build a true gen…

I am a general intelligence, with the knowledge of the internet at my fingertips, and I am not particularly dangerous.

But you have a self preservation instinct honed over millions of years of evolution and some unknown degree (but likely high enough) of socialization. Also, to be honest, you aren't that fast or accurate.
Post reply on HN