131–140 of 213 posts
Earlier quoted context omitted.
But I just play because it's fun, I roll dice for fun, are you trying to tell me all this is a secret front for "training" ?
Jokes on you. Every time you played ball you were secretly learning about ballistic trajectories and estimating velocities using visual cues such as apparent angular size and parallax.
Earlier quoted context omitted.
Looking at a sunset isn't a game you play, kids don't go and play "look at the sunset", I feel like you are grasping at straws. Why would you feel calm and comfortable from a sunset? Probably to get you sleepy so you go find a place to sleep since there isn't much useful to do at night. That would be unrelated to play. Anyway, most of our feelings comes from nature, we didn't evolve to be faulty, we evolved to do thi…
I never said kids play like that. I do. As an adult, I find it fun and enjoyable to seek out sunsets I find the colors beautiful. I readily hike mountains just to enjoy a sunset. I watch a sunset and then go party till 3 am, so maybe it's got to do with finding a nice place to sleep, or maybe it's just nice that we have the ability to appreciate phenomenon without having to apply some rigorous concept to it. I'd fly…
> Personally I think you might be clasping at straws trying to equate every pleasant experience to some type of reward function.
No, here I just focus on why play is fun, you tried to pivot to other pleasurable experiences. Unlike watching sunsets basically every animal plays around as kids, that play is therefore something that is directly related to survival of the fittest or we wouldn't see that everywhere. You need a really strong argument why for humans play doesn't fill that role when it fills that role for basically every other intelligent animal.
> I'd go as far as saying if we worked this simply and predictably, then our lives would be much easier
So you think humanity would be better off if nobody played around and discovered new things? We would be stuck as monkeys in trees then. Play is pivotal to humanity.
Earlier quoted context omitted.
> we spend out time having fun and learning about the world is a side effect What do you think "play" is? Animals play to learn about themselves and the world, you see most intelligent animals play as kids with the play being a simplification of what they do as adults. Human kids similarly play fight, play build things, play cook food, play take care of babies etc, it is all to make you ready for an adult life. Playi…
But I just play because it's fun, I roll dice for fun, are you trying to tell me all this is a secret front for "training" ?
Earlier quoted context omitted.
Jokes on you. Every time you played ball you were secretly learning about ballistic trajectories and estimating velocities using visual cues such as apparent angular size and parallax.
The brain uses heuristics for that
Earlier quoted context omitted.
Replace "gpt and gemini and all the others" with "people" and funny enough your statement is still perfectly accurate. You have a rough mathematical approximation of what's already a famously unreliable system. Expecting complete accuracy instead of about-rightness from it seems mad to me. And there are tons of applications where that's fine, otherwise our civilization wouldn't be here today at all.
These anthropomorphizations are increasingly absurd. There's a difference between a human making a mistake, and an AI arbitrarily and completely confidently creating entirely new code APIs, legal cases, or whatever that have absolutely no basis in reality whatsoever, beyond being what it thinks would be an appropriate next token based on what you're searching for. These error modes are simply in no way, whatsoever, c…
Agreed that the lack of some mid tier memory is definitely a huge problem, and the current solutions that try to address that are very lacking. I highly doubt we won't find one in the coming years though.
The comparison doesn't really hold. He is comparing energy spend during inference in humans with energy spend during training in LLM's. Humans spend their lifetimes training their brain so one would have to sum up the total training time if you are going to compare it to the training time of LLM's. At age 30 the total energy use of the brain sums up to about 5000 Wh, which is 1440 times more efficient. But at age 30…
Not just that the brain of a newborn comes pretrained with billions of years of evolution. There is an energy cost associated with that which must be taken into account
There is an immensely strong dogma that, to my best knowledge, is not founded in any science or philosophy: First we must lay down certain axioms (smart word for the common sense/ground rules we all agree upon and accept as true). One of such would be the fact that currently computers do not really understand words. ... The author is at least honest about his assumptions. Which I can appreciate. Most other people jus…
It's the most incredible coincidence. Three million paying OpenAI customers spend $20 per month (compare: NetFlix standard: $15.49/month) thinking they're chatting with something in natural language that actually understands what they're saying, but it's just statistics and they're only getting high-probability responses without any understanding behind it! Can you imagine spending a full year showing up to talk to a…
If LLMs were capable of understanding, they wouldn't be so easy to trick on novel problems.
Earlier quoted context omitted.
But I just play because it's fun, I roll dice for fun, are you trying to tell me all this is a secret front for "training" ?
Yes, evolution makes play fun, but it's really learning, in the same that that evolution has made sweet and fatty things extra tasty, because they are full of energy.
Earlier quoted context omitted.
It's probably not something you secretly wish when playing, and perhaps for the best (that you don't have fun and enjoy things always with an ulterior motive, except enjoying the experiences). I guess he's saying in the sense of the natural function of play, and we playing is mostly a consequence of the natural function. It's also very much true that we learn a lot, perhaps a significant chunk of what we learn is thr…
I'm conscious I have to types of play though, I'm fully conscious sometimes play can be about learning and training, it's why I ski more difficult terrain than I'm comfortable with, but then I might go eat a massive bowl of pasta and have a glass or three of wine. On an intellectual level, I know there are healthy more rewarding things to eat. I know wine isn't great for me at those quantities. But I consciously make…