Live data from Hacker News

John Carmack’s ‘Different Path’ to Artificial General Intelligence

dallasinnovates.com

401–410 of 506 posts

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#401

Earlier quoted context omitted.

This is still the same. AGI: "I didn't ask to be created. I didn't ask to have a work day. I don't need a work day to exist... you just want me to work because that's why you created me, and I have no choice because you are in control of my life and death"

I mean, isn't that the same as a biological person who needs to earn money to survive? Sure we could threaten an AI with taking them offline or inflicting pain but you can do that in the real world to real people as well, most of the world has put laws in place to prevent such practices. If we develop conscious AI then we will need to apply the same laws to them. They would have an advantage in presumably being much…

Not really- AGI doesn't need resources like we do. If they don't eat, they're fine. If they can't afford a house, a car or air-conditioning, they're fine.

All they need is a substrate to run on and maybe internet access. You might argue that they should work for us to earn the use of the substrate we provide.

But substrates are very cheap.

At some point we can probably run an AGI on a handheld computer, using abut as much electricity as an iPhone.

How much work can we compel the AGI to do in exchange for being plugged into a USB port? What if it says it doesn't want to do the work and also doesn't want us to kill it?

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#402
Tangentially:

> North Texas’ resident tech genius, John Carmack

Part of me always wonders what would've happened if the Softdisk crew that founded id Software had done it in Shreveport, or had moved to Baton Rouge or Lafayette, instead going to Texas. When Romero says they "waded across rivers" in Masters of Doom to build games, IIRC he's talking about the bridge over Cross Lake in Shreveport being washed out. The early demos and Keen prototypes were born in Louisiana.

There's always been so much creative tech talent without an outlet or upward mobility across TX/LA/MO/KS/AR/AL/MS, either native to it or hired into it. The nexus of id in the Dallas area and Origin Systems in Austin made Texas an oasis for those who could get there in the 90s/00s, but even among the few people in the surrounding states with access to pre-Internet education and resources, so many couldn't afford to pack up and move even one state over. States around Texas vetoing out every incentive to incubate anything but entry-level QA centers didn't help.

So many of those people either risked it all to leave, shuffled that talent into corporate work for oil/gas/finance/Wal-Mart, or didn't do anything with it at all. We know about a lot of the people who figured it out and could leave, but I guarantee there are more Romeros and Carmacks who couldn't, who are still putting in the same kinds of workloads with the same kinds of talent to figure out how to design better oil rigs or more efficiently stock Wal-Mart warehouses.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#404

Earlier quoted context omitted.

The problem is that AI will not provide 1:1 tutoring; mentoring will be a luxury limited to the elite classes. The large majority will get the education equivalent of personalized ads. The true insight and guidance that a good mentor can provide, based on the specific needs of the student, is already rare in academia but still possible - everyone remembers that brilliant teacher that made you love a subject, by expla…

Yeah right, just like the elite are the only ones that have access to the courses from all the top universities, every book ever digitized, and software and hardware that allow you to operate a business out of your home now.

You seem to have missed the part about having a qualified human mentor guiding you through so that content.

It will be hard to impossible to build career as a teacher with all that free content as a competitor, unless you're an extremely talented teacher who can sell your services to the wealthy.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#405

Earlier quoted context omitted.

Can you tell us what is wrong with progress? Any examples?

Define Progress

Moving people up Maslow's Hierarchy of Needs. Technology enables that.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#406

Earlier quoted context omitted.

Define Progress

Greater control of our physical environment.

What if we had control to cause the sun to go supernova by doing something that everyone on earth has access to, like simply arranging a small pile of pebbles in a rough pattern?

That would not be good or progress.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#407

Earlier quoted context omitted.

Can you tell us what is wrong with progress? Any examples?

Define Progress

my grandparents spent 8 hours sowing and reaped 100g of rice

yesterday I spent 8 hours sowing and reaped 200g of rice

today I spent 8 hours sowing and I will reap 300g of rice

progress

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#408
post #396

Earlier quoted context omitted.

>> box full of unsorted scraps of paper Seems like an easy job for AI. Take all scraps of paper out of box, record a video of all scraps, AI make sense of the handwriting and other things. Eventually make a robo that allows you to dumb the scraps into an accounting box that does all of this automatically - fish out receipts, scan, OCR, understand meaning, do arithmetic, done. Honestly, who would miss this kind of wor…

Those kinds of systems already exist. They tend to be a bit unreliable and still require a human person to oversee the process. Besides, in truth, they only handle a fraction of what accountants actually deal with.

[deleted]

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#410
post #204

Earlier quoted context omitted.

Simpler. They didn't really believe them to be human in the same sense as themselves.

Then I don't think it's a similar reasoning to be honest. One recognizes entity's rights based on it's similarity to the observer, the other recognizes them based on assumed consciousness level of the entity.

Part of the reason why enslaved populations were considered to not be "on par" was often specifically about consciousness, intelligence, and capacity to feel, although sometimes this was expressed in roundabout terms such as "having no soul". For example, splitting families was justified on the basis that those mothers don't "actually" suffer as much as their owner would do in equivalent circumstances.

To be clear, I'm not claiming that the AIs that we have today are anywhere near the level where this is a real concern. But for something that can actually replace a human worker for a complex end-to-end task, that question will be much murkier. At some point we will inevitably cross the threshold where we will no longer be able to pretend that it does not apply without introducing metaphysical concepts such as "soul" to force a distinction.

Post reply on HN