Live data from Hacker News

Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

languagelog.ldc.upenn.edu

41–50 of 55 posts

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#41

Earlier quoted context omitted.

> Well, that didn't happen. The military had stealth aircraft in the 70's. I'll bet they had LLM or better in the 80's and the tech we have now is the consumer-grade version they seeded into industry in the 2020's.

There's 0 chance of that. You can maybe say that for things like material science, nuclear stuff, weird physics, and so on (basically anything relating to making big booms, delivering big booms, or ensuring others can't make big booms). But having LLMs as we understand them now in the 80s would be impossible. They simply didn't have the compute necessary. The entire world combined didn't have it. For reference, a sin…

Another axis would be power consumption. Pretty sure if you want LLM training in 1980 you'd also need fusion power in 1980. And it would be very, very hard to hide the cooling apparatus of your datacenter.

All that aside, it would also likely mean that the secret chip fabs eclipse the volume of the non-secret chip fabs by orders of magnitude... covertly? Or are we imagining chips that are 30yr ahead of their time? Either way it's just absurdities upon absurdities..

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#42
post #35

Earlier quoted context omitted.

I think it is exposing how weakly people grasp communications. The amount of implied everything in most people's communications is extremely high, and those same people do not understand they are using implied information that a non-human construct really struggles to figure out what the human is talking about. I help a lot of non-technical people use AI, and asking them not to imply and to explain what they mean...…

Yes. Furthermore, when I write precisely - because it's an important subject (read: will cost the company money) where we must be on the same page - people's eyes glaze over, and they ask for a meeting or a phone call instead. So, we do that, and I answer all the questions, and then everyone goes away with a different idea about what we're talking about. The only person who doesn't do that is our controller, who'll t…

> I'm sure it's my fault, somehow - but I'm a damn good writer; I just don't know how to communicate with people who won't put forth the effort to engage with detail.

I used to put effort into those people. It was a waste of time. Now I just do everything I can to ignore them, work around them, etc.

Knowledge workers who won't engage with the material are just like ditch diggers who won't touch a shovel. They're dead weight, and organizations that fail to cull them are doing it all wrong.

Sadly, that's most of them these days.

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#43

Earlier quoted context omitted.

Why are you so certain you know what tech existed in the 80's? NASA used Commodore 64's as part of the constellation of computers needed to launch the space shuttle. That whole program was pretty hokey. That silliness doesn't preclude some radically advanced compute tech from existing elsewhere at the same time. Of course something like that would be ultra secret and you and I wouldn't be told about it. You have to b…

I just try to keep an open mind to these sorts of things. An open mind doesn't mean "a mind full of open circuits." Why are you so certain you know what tech existed in the 80's? Useful LLMs could not have been built without deep-UV semiconductor fabrication at scale, which in turn can't exist without a massive, complex supply chain that envelops the globe like a spiderweb. Such technology could not have been built s…

Because an LLM is the only way to express intelligence with a computer. So your conception of ram/cpu/storage/networks and learning (training on huge corpus of data) is the only way to do artificial intelligence?

LLM's are the perfect consumer-grade AI, safe to release to the public. It lacks creativity so little chance for a runaway super-intelligence, and it gives the people real tools. It's the best case. Isn't it tidy how reality is? Almost seems planned.

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#44
post #39

Up to five years ago[^1], we lived an age of pure speculation about intelligence and minds. That age brought about multiple theories of the mind, and to me, their finest legacy are arguments of the form "$X is not $concept because $theory", where any given day $X can be "LLM" or "LLM+harness+tool", "agent" and $concept can be "intelligent", "aware", "rational", "long-termed", , etc. Those arguments, in the context of…

> depending on where you draw the line between fine intelligence and stochastic parrots.

I'm always amused by this argument. "Stochastic parrot" is pretty much what most humans are, most of the time. I suppose you could add "stochastic parrots who believe they're conscious" if you want to be complete.

Where do your thoughts come from? This has been explored quite a bit long before LLMs, and the answer is, they essentially come from our subconscious minds, and the evidence shows that the we don't exert nearly as much conscious control over that as we imagine we do.

Given what we know, it's quite reasonable to conclude that our thoughts are a function of our biological neural network(s), which are responding to inputs with the outputs that they've been programmed to produce by a lifetime of training.

How is that any different from an LLM, in terms of the overall principle? I.e., if LLMs are stochastic parrots, then so, most likely, are we.

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#45
post #27

Earlier quoted context omitted.

>> It is more probable than not that, within the twentieth century, an ultraintelligent machine will be built and that it will be the last invention that man need make, since it will lead to an “intelligence explosion.” > Well, that didn't happen. Predictions are not false because their claims are not in the past yet. That bar would make all predictions wrong. The faster things happen, the higher the speed-of-progres…

I don't think it's a knock on the original prediction to say it didn't turn out to be true. In fact, at the time it probably felt like a pretty conservative prediction. That being said, if you think back to the year 2000, we were pretty far from building such a machine at that time. To me it's an interesting lesson in how hard it is to predict technology advances which still applies to our own predictions of the futu…

[deleted]

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#46
post #40

Earlier quoted context omitted.

I realize this may sounds like a lot of effort, but I find telling stories of how a person would use the system, with theatrics of confusion and failure, tend to penetrate the dull unwilling to think participants I must engage to get my work completed. I'm not an actor or a good speaker, I grew up with a severe stutter, and I find I have to "put on a show" to generate the dawn of comprehension in others.

Funnily enough, I am (was) an actor. Public speaking and telling stories are my jam. So... I do all that. I love making wacky analogies to help people understand complex systems. Higher-level decision-making, I find, isn't so much like that. Sometimes it's just tradeoffs: "if the company's going this direction, then A is better; but if that , then B". But they haven't even recognized the this and the that - and don't…

I've been working for far too freaking long, so I've had a series of pointy haired bosses (referencing Dilbert here). I once had a boss that really fought for the technical reasons every time, exhausing upper management until they gave in. Years later, socially chatting with one of the upper managers from that company, which I'd long left, about that manager and how much his team loved him. The manager's response was "that was the last on-spectrum manager we hired. never again!" and my opinion dimmed.

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#47
post #42
post #35

Earlier quoted context omitted.

Yes. Furthermore, when I write precisely - because it's an important subject (read: will cost the company money) where we must be on the same page - people's eyes glaze over, and they ask for a meeting or a phone call instead. So, we do that, and I answer all the questions, and then everyone goes away with a different idea about what we're talking about. The only person who doesn't do that is our controller, who'll t…

> I'm sure it's my fault, somehow - but I'm a damn good writer; I just don't know how to communicate with people who won't put forth the effort to engage with detail. I used to put effort into those people. It was a waste of time. Now I just do everything I can to ignore them, work around them, etc. Knowledge workers who won't engage with the material are just like ditch diggers who won't touch a shovel. They're dead…

Careful, because some of those you overlook are probably favorites of management. For who knows what reason, but it surprises me how many times a seemingly deadweight team member just happens to be the owner's kid or some such nepo-baby.

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#48
post #42

Earlier quoted context omitted.

> I'm sure it's my fault, somehow - but I'm a damn good writer; I just don't know how to communicate with people who won't put forth the effort to engage with detail. I used to put effort into those people. It was a waste of time. Now I just do everything I can to ignore them, work around them, etc. Knowledge workers who won't engage with the material are just like ditch diggers who won't touch a shovel. They're dead…

Careful, because some of those you overlook are probably favorites of management. For who knows what reason, but it surprises me how many times a seemingly deadweight team member just happens to be the owner's kid or some such nepo-baby.

Yeah I've stepped on that face rake a few times. I still think it's a decent heuristic, don't see any reason to change.

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#49

Earlier quoted context omitted.

>> It is more probable than not that, within the twentieth century, an ultraintelligent machine will be built and that it will be the last invention that man need make, since it will lead to an “intelligence explosion.” > Well, that didn't happen. Predictions are not false because their claims are not in the past yet. That bar would make all predictions wrong. The faster things happen, the higher the speed-of-progres…

>>> It is more probable than not that, within the twentieth century, an ultraintelligent machine will be built and that it will be the last invention that man need make, since it will lead to an “intelligence explosion.” >> Well, that didn't happen. > Predictions are not false because their claims are not in the past yet. "Within the twentieth century" places it definitely in the past, and definitely false.

> It is more probable than not that, within the twentieth century

Ouch! Well ok then!

Zoom out in time, and the explosion started in the 20th century. But the pop, while near, has yet to come.

Mea culpa.

Re: Speculations Concerning the First Ultraintelligent Machine (1965) [pdf]

#50

> Let an ultraintelligent machine be defined as a machine that can far surpass all the intellectual activities of any man however clever. That's a pretty early definition of what we now call ASI (Artificial Super Intelligence). In the next paragraph the author goes to describe what we today call the "singularity" (ASI designing better ASI). But that term seems to be associated to some very weird communities, so the c…

> The required high degree of connectivity might be attained with the help of microminiature radio transmitters and receivers.

I mean pretty much everything has a wifi chip these days

Post reply on HN