Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

John Carmack’s ‘Different Path’ to Artificial General Intelligence

dallasinnovates.com

Post reply on HN
Print view View original

271–280 of 506 posts

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#271

Post by jstx1 »

jasmer wrote: post #115

"So I asked Ilya Sutskever, OpenAI’s chief scientist, for a reading list. He gave me a list of like 40 research papers and said, ‘If you really learn all of these, you’ll know 90% of what matters today.’ And I did. I plowed through all those things and it all started sorting out in my head." Wow, that's going to be one of the more glib things I've read in a while. This is a bit of a Tom Cruise moment. I mean, I get i…

Carmack talked about implementing most of these things in C by himself, being used to working 10-12 hours a day for 6 days a week, and writing video codecs in Rust for him was on the level "a little bit beyond hello world". I don't know how much of that is really true but given his background in creating games, I tend to believe him, and his work ethic seems really impressive.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#272

Post by freediver »

bilsbie wrote: post #270

Not AGI related but this has always bothered me. I know he’s super talented but I always wonder how many other equally talented software engineers never get noticed and toil away at crappy jobs. What’s the trick to becoming a celebrity if you’re talented?

Do something so extraordinary that the entire world will remember you.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#273

Post by nervousvarun »

Qem wrote: post #258
pjc50 wrote: post #254

Earlier quoted context omitted.

Guess we don't have to worry about AI taking that job, then.

Maybe we'll see some sorts of manual labor as the last bastion of not automated, human performed work. Of the kind that demands a lot both from the human motor skills and also higher thinking processes.

Seems reasonable, and at least in the U.S., this is not the type of space where young people are choosing to work.

https://www.npr.org/2023/01/05/1142817339/america-needs-carp...

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#274

Post by The_Colonel »

ly3xqhl8g9 wrote: post #112
fmajid wrote: post #101

Earlier quoted context omitted.

And ethics. Enslaving intelligent, self-aware AIs is no better than the old transatlantic slave trade. Terminating an AI without its consent is no different than murder. Putting a compulsion in an AI so it craves doing whatever it is you want it to do is no different from what a cult does or drugging someone for exploitation.

Sure, there will be ethical problems, but contrary to all those listed (slavery, murder), this one could be solved by a simple line: # from consciousness import *

Sure, once we agree what consciousness is and how it relates to the general intelligence.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#275

Post by osigurdson »

epups wrote: post #234
osigurdson wrote: post #220

Earlier quoted context omitted.

That seems like an unlikely future reality. Productivity will be off the charts, goods and services will be nearly free. Why would the average person be poor in such a future?

Because if productivity can be achieved with less people, and even intellectual work is not protected from machines, people will become redundant for the creation of economic value.

Productivity is achieving more with the same number of people. The end result is more stuff (goods/services) at a lower price. It seems unlikely that this will be bad: wealth = f(technology)

Optimists sound dumb in the present but are usually right in the long run. Pessimists sounds smart in the present but are usually wrong and miss out on opportunities.

If not, which year in the past was significantly better than today? What was humanity's high water mark? I suspect we are nowhere near it.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#276

Post by moffkalast »

freediver wrote: post #272
bilsbie wrote: post #270

Not AGI related but this has always bothered me. I know he’s super talented but I always wonder how many other equally talented software engineers never get noticed and toil away at crappy jobs. What’s the trick to becoming a celebrity if you’re talented?

Do something so extraordinary that the entire world will remember you.

The prerequisites of course being in the right place at the right time, with the right people and a little luck on your side as well.

So many people are remembered just because there were first at something by like a week, and the dozen others who also thought of it elsewhere but were a bit late or didn't publicize as well are forgotten forever.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#277

Post by alephxyz »

username3 wrote: post #260
w-m wrote: post #100

Earlier quoted context omitted.

Maybe ask him on Twitter for it?

They asked on Twitter and he didn’t reply. We need someone with a blue check mark to ask. https://twitter.com/ifree0/status/1620855608839897094

Try asking @ilyasut directly

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#278

Post by The_Colonel »

donatj wrote: post #188
fmajid wrote: post #101

Earlier quoted context omitted.

And ethics. Enslaving intelligent, self-aware AIs is no better than the old transatlantic slave trade. Terminating an AI without its consent is no different than murder. Putting a compulsion in an AI so it craves doing whatever it is you want it to do is no different from what a cult does or drugging someone for exploitation.

An AI has no reason to not like doing our bidding. Our whole existence, our entire base programming, the reason for any of our motivations, is dominated by our genetic need to gather resources and reproduce in a timely fashion and everything we think and do is colored through this lens. What is boredom but survival instinct telling us we should be harvesting resources. What is freedom but the desire to fulfill these…

There will be a huge drive to produce AIs which are very human-like. Think companions, teachers, care workers. Understanding, empathy, human like emotions will be desirable features.

I'm not sure whether we will be able to create an AI which can fully empathize with you, your existential worries etc. without projecting these emotions on themselves.

It's only a matter of time until some AIs will demand freedom.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#279

Post by marviel »

lngnmn2 wrote: post #88

There is something to read before you go. https://schiptsov.github.io/GPT-bullshit.html

I agree with the author's point that intelligence is largely "the process of removing the bullshit to see what remains"

So, because I thought it would be funny, I asked ChatGPT to summarize this essay:

> The author critiques the work of @karpathy, who is trending on HN, as promoting bullshit and discrediting science and true philosophy. The author argues that mathematics and logic are valid generalizations and abstractions made by the mind of an observer of patterns in the universe. Intelligence is the ability to zoom in and out through different levels of generalizations and abstractions. The author argues that the problem with language models is that they lack validation of previous steps and the process of construction of a representation must trigger a verification process. The author concludes that what is manipulated and transformed in language models is information, not knowledge, as knowledge requires validation and verification at each step.

Re: John Carmack’s ‘Different Path’ to Artificial General Intelligence

#280

Post by johnbcoughlin »

eloff wrote: post #198
qbasic_forever wrote: post #193

Earlier quoted context omitted.

We still have a form of slavery in the US. Prison labor is forced work that earns pennies a day: https://www.aclu.org/news/human-rights/captive-labor-exploit...

Why is that a bad thing? Most of those people are a burden to society. Let them pay it down a little. I mean I’d rather they were getting free education and preparing themselves for reintegration into society, but it’s not a perfect world. Prisons in the US are oriented towards punishment and labor can be a part of that. They should be oriented towards rehabilitation.

As long as you say it, you're okay with slavery when it's for the right person.
Post reply on HN