261–270 of 347 posts
The only test I ever want to see with these frame-gen models is a full 1080 degree camera spin. Miss me with that 30 degree back and forth crap. I want multiple full turns. Some jitter and a little back-and-forth wobble is fine. But I want multiple full spins.
I’m pretty sure I know why they don’t do this :)
Everyone here seems too caught up in the idea that Genie is the product, and that its purpose is to be a video game, movie, or VR environment. That is not the goal. The purpose of world models like Genie is to be the "imagination" of next-generation AI and robotics systems: a way for them to simulate the outcomes of potential actions in order to inform decisions.
I have been confused for a long time why FB is not motivated enough to invest in world models, it IS the key to unblock their "metaverse" vision. And instead they let go Yann LeCun.
Now I can't stop thinking about _The Experience Machine_ by Andy Clark. It theorizes that this is how humans navigate and experience the real world: Our brains generate what we think the world around is like and our senses don't so much directly process visual information but instead act like a kind of loss function for our internal simulations. Then we use that error to update our internal model of the world. In thi…
Let me introduce you to Idealism And more specifically Analytic Idealism https://youtu.be/P-rXm7Uk9Ys?si=q7Kefl7PbYfGiChZ Google DeepMind’s Project Genie is being framed as a “world model.” Given a text prompt, it generates a coherent, navigable, photorealistic world in real time. An agent can move through it, act within it, and the world responds consistently. Past interactions are remembered. Physics holds. Cause a…
Earlier quoted context omitted.
I think this is pretty well established as far as neurologists are concerned and explains a lot of things. Like dreaming for instance.. just something like the model running without sensory input constraining it.
Could you please give some sources - books or articles or videos on that topic? It's really fascinating
It goes through how sensations fit into this highly constrained, highly functional hallucination that models the outside world as a sort of bayesian prediction about the world as they relate to your concerns and capabilities as a human, and then it has a very interesting discussion about emotions as they relate to inner bodily sensations.
Now I can't stop thinking about _The Experience Machine_ by Andy Clark. It theorizes that this is how humans navigate and experience the real world: Our brains generate what we think the world around is like and our senses don't so much directly process visual information but instead act like a kind of loss function for our internal simulations. Then we use that error to update our internal model of the world. In thi…
We are never able to interact with the physical world directly, we first perceive it and then interpret those perceptions. More often than not, our interpretation ignores and modifies those perceptions, so we really are just living in a world created by our own mental chatter.
This is one of the core tenets of Buddhism, and it's also expounded on Greg Egan's short novel "Learning to Be Me". He's one of my favorite sci-fi authors and this particular short led me down a deep rabbit hole of reading many of his works within a few months.
I found a copy online, if you haven't read it, do yourself a favor and check it out. You won't be able to put it down and the ending is sublime. https://gwern.net/doc/fiction/science-fiction/1995-egan.pdf
Earlier quoted context omitted.
It's "Facebook Artificial Intelligence Research", not fundamental. So basically involves both fundamental and applied research. [1]: https://engineering.fb.com/category/ai-research/
Ref: Yann lecun post on linkedin, 3years ago: FAIR now stand for "Fundamental AI Research"