Great essay; impressive content. The fact that it's very unlikely for any of the current models to create something that even remotely resembles this article tells me we are very far away from AGI.
Did you miss the disclaimer at the bottom that both visual artwork and prose were produced by a combination of generative AI tools and creative prompting? The entire seamless watercolor style piece was just a long outpainting
Is my toddler a stochastic parrot?
11–20 of 363 posts
Re: Is my toddler a stochastic parrot?
#12Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…
Like it somehow diminishes us. Reduces us to cogs and levers and such.
But I can't imagine how it could be otherwise, though. I'm still baffled by the existence of qualia, phenomenology, etc. Awareness. But bafflement on that front isn't a good reason to reject the possibility that the only thing that separates me from a computer is the level of complexity. Or the structure of the computation. Sometimes things are just weird.
Re: Is my toddler a stochastic parrot?
#13Great essay; impressive content. The fact that it's very unlikely for any of the current models to create something that even remotely resembles this article tells me we are very far away from AGI.
Did you miss the disclaimer at the bottom that both visual artwork and prose were produced by a combination of generative AI tools and creative prompting? The entire seamless watercolor style piece was just a long outpainting
Re: Is my toddler a stochastic parrot?
#14Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…
> I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Almost every time I'm on hackernews I end up baffled by software engineers feeling entitled to have an unfunded opinion on scientific disciplines outside of their own field of expertise. I've literally never encountered that level of hubris from any…
Re: Is my toddler a stochastic parrot?
#15The AIs will be creating masterwork art and literature personalized for each person better than anything Shakespeare ever wrote or Michaelangelo ever sculpted, but we'll console ourselves that at least we're _really_ conscious and they're just stochastic parrots.
Re: Is my toddler a stochastic parrot?
#16She quickly generalized; henceforth, both of them were "catten".
Re: Is my toddler a stochastic parrot?
#17Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…
> I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Almost every time I'm on hackernews I end up baffled by software engineers feeling entitled to have an unfunded opinion on scientific disciplines outside of their own field of expertise. I've literally never encountered that level of hubris from any…
You'd think that software engineers would be a group that easily understands how making radical assumptions about implementation details when looking at nothing but an interface is generally misguided.
I'm not saying that there isn't a strong case to be made against LLMs being intelligent. It's pointing at the stochastic parrot as evidence enough in of itself that confuses me.
Re: Is my toddler a stochastic parrot?
#18Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…
> I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Almost every time I'm on hackernews I end up baffled by software engineers feeling entitled to have an unfunded opinion on scientific disciplines outside of their own field of expertise. I've literally never encountered that level of hubris from any…
Re: Is my toddler a stochastic parrot?
#19Often the "stochastic parrot" line is used as a reduction on what an LLM truly is. I firmly believe that LLMs are stochastic parrots and also that humans are too. To the point where I actually think even consciousness itself is a next-token predictor. Where the industry is headed - multi-modal models. This really I think is the remaining frontier of LLM Human parity. I also have a 15 month old son. It's totally obvio…
Humans definitely create new information. (Well, at least some humans do.)
Re: Is my toddler a stochastic parrot?
#20I wonder when the rate of improvement of SOTA benchmarks will exceed the rate of improvement of irl early childhood cognitive development
Imagine the contribution to GNP if we in practice, like Bokanovsky* (by Ford!) in fiction, could greatly reduce the 10-30 year lead time currently required to produce new employees...
Edit: * cf https://www.depauw.edu/sfs/notes/notes47/notes47.html