Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Unpredictable abilities emerging from large AI models

quantamagazine.org

Post reply on HN
Print view View original

271–280 of 326 posts

Re: Unpredictable abilities emerging from large AI models

#271

Post by bbor »

selestify wrote: post #257
hgsgm wrote: post #227

Earlier quoted context omitted.

What's even more bizarre is the ChatGPT is proving him right , that a neural net can build logical grammar, and he is denying it!

What did he say about logical grammars and neural nets in the past? Sorry, not very familiar with him.

He wrote an op ed recently with the oft-repeated argument that stochastic models are fundamentally distinct from structured symbolic/logical models. In simple terms you can never really “trust” chatgpt’s answers because it’s just guessing the answer that looks right, not applying structured reasoning like humans do.

https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chat...

But might be missing something more specific, would love to read that.

Re: Unpredictable abilities emerging from large AI models

#273

Post by HervalFreire »

Jeff_Brown wrote: post #232
_dain_ wrote: post #98

Earlier quoted context omitted.

> When these LLMs get normalized probably 5 years from now I'm going go back to these old threads and contact these people who are in self denial and throw it in their face. I'll just link this comment and be like I TOLD YOU, I TOLD YOU, YOU WERE WRONG. this isn't a kind thing to do.

Nor rational. What a strange impulse.

[flagged]

Re: Unpredictable abilities emerging from large AI models

#274

Post by Izkata »

Jeff_Brown wrote: post #132
anon7725 wrote: post #119

Earlier quoted context omitted.

Sledge hammer #1 (voice assistants, AI chips in phones) didn’t cause unemployment. It was at the level of new features and capabilities. Sledge hammer #2 is aimed squarely at “white collar” work without much in the way of bounds to its capabilities.

We can't trust it. That's a pretty hard bound.

There was an episode in the original Kino's Travels anime where in one country, where a computer ran everything, humans still had jobs - their work was basically just verification that the computer was correct.

Re: Unpredictable abilities emerging from large AI models

#275

Post by noonething »

mark_l_watson wrote: post #144

Nice write up! I have been using classic back-prop neural networks since the 1980s, and deep learning for the last 8 years. This tech feels like a rocket ship that is accelerating exponentially! I am in my 70s and I don't work much anymore. That said, I find myself spending many hours in a typical day doing what I call "gentleman scientist" activities around Large Language Models. I was walking this morning with a no…

are you finding langchain and llama-index similar?

Re: Unpredictable abilities emerging from large AI models

#276

Post by Izkata »

bbor wrote: post #271
selestify wrote: post #257

Earlier quoted context omitted.

What did he say about logical grammars and neural nets in the past? Sorry, not very familiar with him.

He wrote an op ed recently with the oft-repeated argument that stochastic models are fundamentally distinct from structured symbolic/logical models. In simple terms you can never really “trust” chatgpt’s answers because it’s just guessing the answer that looks right, not applying structured reasoning like humans do. https://www.nytimes.com/2023/03/08/opinion/noam-chomsky-chat... But might be missing something more sp…

> In simple terms you can never really “trust” chatgpt’s answers because it’s just guessing the answer that looks right, not applying structured reasoning like humans do.

Here's an argument otherwise, that they really are developing some sort of model: https://the-decoder.com/stochastic-parrot-or-world-model-how...

Re: Unpredictable abilities emerging from large AI models

#277

Post by michaelmrose »

UncleOxidant wrote: post #248
drdec wrote: post #201

Earlier quoted context omitted.

> Certainly the rise of LLMs and generative AI isn't going to be all bad, but I've also got a feeling that not as many software developers will be needed soon since those who can leverage LLMs will experience a pretty decent productivity boost. OTOH, software development will become significantly cheaper. That means the business case for using software in more places just tilted in favor of throwing some software at…

> You'll see more and more businesses using it, ones you didn't expect, like local mom and pop businesses. And in a lot of cases they're not going to need to hire a software developer to do develop it.

What do you call the person they are going to hire to use the tool or are they going to switch gears from selling painted dodads and chicken sandwiches to fire up an IDE even a web based one.

The average human is only slightly smarter than the average rabbit. They are going to pay someone who specializes in this task.

Re: Unpredictable abilities emerging from large AI models

#278

Post by Llamamoe »

crote wrote: post #269
2OEH8eoCRo0 wrote: post #237

Earlier quoted context omitted.

I've been calling the mockery and dismissiveness, "nervous laughter". I think we have a sharp crowd here but they either lack imagination or are in denial.

I do not think that is quite true. Most of what I am seeing is hesitance and wariness. Every innovation can be used both for good and for evil, and it often has unintended side-effects. Just ask Thomas Midgley Jr., who played a major role in both leaded gasoline and CFCs. Or Alfred Nobel, who tried to make mining safer, only to be appalled at an erroneous obituary to describe him as the "merchant of death" due to its…

We're at a point in time where almost any novel technology is just going to take jobs away, increase wealth inequality, and down the line make the world a worse place. It's difficult to be happy about a new powerful tool finding its way into the hands of tech giants.

Re: Unpredictable abilities emerging from large AI models

#279

Post by ImHereToVote »

hgsgm wrote: post #230
ImHereToVote wrote: post #191

Earlier quoted context omitted.

Who needs slaves? What use will they be? Why overproduce?

Overproduce so that the plebs have something after the elites seize the lion's share

Who needs plebs? I mean, a couple of thousand. Maybe, But beyond that?

Re: Unpredictable abilities emerging from large AI models

#280

Post by HyperSane »

bandofthehawk wrote: post #239
HyperSane wrote: post #215

Earlier quoted context omitted.

About foreign policy? No.

Was he wrong to oppose the Vietnam war?

He supported the communist though. He also supported Pol Pot. You can predict his opinions of foreign policy if you understand that he bases them on the "US is evil" axiom and therefore anyone who opposes it is good, no matter how actually evil they may be.
Post reply on HN