Live data from Hacker News

Is my toddler a stochastic parrot?

newyorker.com

11–20 of 363 posts

Re: Is my toddler a stochastic parrot?

#11

Great essay; impressive content. The fact that it's very unlikely for any of the current models to create something that even remotely resembles this article tells me we are very far away from AGI.

Did you miss the disclaimer at the bottom that both visual artwork and prose were produced by a combination of generative AI tools and creative prompting? The entire seamless watercolor style piece was just a long outpainting

hahaha that's why I love HN :)

Re: Is my toddler a stochastic parrot?

#12
post #5

Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…

I'm in the same boat. It feels wrong to contemplate that our consciousness might not be a magical independent agent with supernatural powers, but is rather an emergent property of complex-but-deterministic actions and reactions.

Like it somehow diminishes us. Reduces us to cogs and levers and such.

But I can't imagine how it could be otherwise, though. I'm still baffled by the existence of qualia, phenomenology, etc. Awareness. But bafflement on that front isn't a good reason to reject the possibility that the only thing that separates me from a computer is the level of complexity. Or the structure of the computation. Sometimes things are just weird.

Re: Is my toddler a stochastic parrot?

#13

Great essay; impressive content. The fact that it's very unlikely for any of the current models to create something that even remotely resembles this article tells me we are very far away from AGI.

Did you miss the disclaimer at the bottom that both visual artwork and prose were produced by a combination of generative AI tools and creative prompting? The entire seamless watercolor style piece was just a long outpainting

I read the article, read your comment, went back to review the article, and there was no such disclaimer. If this is /s, whoosh.

Re: Is my toddler a stochastic parrot?

#14
post #5

Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…

> I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Almost every time I'm on hackernews I end up baffled by software engineers feeling entitled to have an unfunded opinion on scientific disciplines outside of their own field of expertise. I've literally never encountered that level of hubris from any…

I suspect you don't know what OPs field of expertise is. I also doubt OP would disagree with that statement that the only conscious things we know of have a body and sensorimotor interactions with the environment.

Re: Is my toddler a stochastic parrot?

#15
I suspect people will argue about whether AIs are truly conscious or just stochastic parrots even as all human-dominated tasks are replaced by AIs.

The AIs will be creating masterwork art and literature personalized for each person better than anything Shakespeare ever wrote or Michaelangelo ever sculpted, but we'll console ourselves that at least we're _really_ conscious and they're just stochastic parrots.

Re: Is my toddler a stochastic parrot?

#17
post #5

Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…

> I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Almost every time I'm on hackernews I end up baffled by software engineers feeling entitled to have an unfunded opinion on scientific disciplines outside of their own field of expertise. I've literally never encountered that level of hubris from any…

The befuddlement goes even farther for me. LLMs are, effectively, black-box systems that interface with the world via a stochastic parrot interface.

You'd think that software engineers would be a group that easily understands how making radical assumptions about implementation details when looking at nothing but an interface is generally misguided.

I'm not saying that there isn't a strong case to be made against LLMs being intelligent. It's pointing at the stochastic parrot as evidence enough in of itself that confuses me.

Re: Is my toddler a stochastic parrot?

#18
post #5

Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…

> I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Almost every time I'm on hackernews I end up baffled by software engineers feeling entitled to have an unfunded opinion on scientific disciplines outside of their own field of expertise. I've literally never encountered that level of hubris from any…

Are you saying that ie. paralyzed people don't have consciousness?

Re: Is my toddler a stochastic parrot?

#19
post #5

Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…

LLMs don't create new information, they only compress existing complexity in their train and inference data sets.

Humans definitely create new information. (Well, at least some humans do.)

Re: Is my toddler a stochastic parrot?

#20

I wonder when the rate of improvement of SOTA benchmarks will exceed the rate of improvement of irl early childhood cognitive development

Jared Diamond mentions several attributes which make a species suitable for domestication. Humans fit all but one: we are almost too altricial to be suitable for economic exploitation.

Imagine the contribution to GNP if we in practice, like Bokanovsky* (by Ford!) in fiction, could greatly reduce the 10-30 year lead time currently required to produce new employees...

Edit: * cf https://www.depauw.edu/sfs/notes/notes47/notes47.html

Post reply on HN