311–320 of 512 posts
What format do these world models output? Since it's interactive, it's not just a video...does DeepMind have some kind of proprietary runtime or what?
I think it just outputs image frames...
Earlier quoted context omitted.
> Future robots may learn in their dreams... So prescient. I definitely think this will be a thing in the near future ~12-18 months time horizon
I may be wrong, but this seems to make no sense. A neural net can produce information outside of its original data set, but it is all and directly derived from that initial set. There are fundamental information constraints here. You cannot use a neural net to itself generate from its existing data set wholly new and original full quality training data for itself. You can use a neural net to generate data, and you ca…
The LLM has plenty of experts and approaches etc.
Give it tool access let it formulate it's own experiments etc.
The only question here is if it becomes a / the singularity because of this, gets stuck in some local minimum or achieves random perfection and random local minimum locations.
Earlier quoted context omitted.
> What I don't think this technology will do is replace game engines. I just don't see how you could get the very precise and predictable editing you have in a regular game engine from anything like the current model. The real advantage of game engines is how they allow teams of game developers to work together, making small and localized changes to a game project. I've been thinking about this a while and it's obvio…
As a renderer, given a POV, lighting conditions, and world mesh might be a very, very good system. Sort of a tight MCP connection to the world-state. I think in this context, it could be amazing for game creation. I’d imagine you would provide item descriptions to vibe-code objects and behavior scripts, set up some initial world state(maps), populated with objects made of objects - hierarchically vibe-modeled, make a…
> It would blow up the game industry, but also spawn a million independent one or two person studios producing some really imaginative niche experiences that could be much, much more expansive (like a AAA title) than the typical indie-studio product.
All video games become Minecraft / Roblox / VRChat. You don't need AAA studios. People can make and share their own games with friends.
Scary realization: YouTube becomes YouGame and Google wins the Internet forever.
Consistency over multiple minutes and it runs in real time at 720p? I did not expect world models to be this good yet. > Genie 3’s consistency is an emergent capability So this just happened from scaling the model, rather than being a consequence of deliberate architecture changes? Edit: here is some commentary on limitations from someone who tried it: https://x.com/tejasdkulkarni/status/1952737669894574264 > - Physi…
I similarly am surprised at how fast they are progressing. I wrote this piece a few months ago about how I think steering world model output is the next realm of AAA gaming: https://kylekukshtel.com/diffusion-aaa-gamedev-doom-minecraf... But even when I wrote that I thought things were still a few years out. I facetiously said that Rockstar would be nerd-sniped on GTA6 by a world model, which sounded crazy a few mont…
I'm starting to think some of the names behind LLMs/GenAI are cover names for aliens and any actual humans involved have signed an NDA that comes with millions of dollars and a death warrant if disobeyed.
Earlier quoted context omitted.
> I like living in a world where I know that people who have spent actually time on nurturing a talent get rewarded for doing so, even if that talent is not something I will ever be good at. Rewarded how? 99.99% of people who do things like sports or artistic like writing never get "rewarded for doing so", at least in the way I imagine you mean the phrase. The reward is usually the experience itself. When someone pic…
99.99% of people, really? You think there isn't a huge swath of the economy that are made up of professional writers, artists, musicians, graphic designers, and all the other creative professionals that the producers of these models aim to replicate the skills of? Why am I so "hung up" on the livelihood of these people? Doing art is a Hobby is a good in and of itself. I did not say otherwise. But when I see a movie,…
Advances in generative AI are making me progressively more and more depressive. Creativity is taken from us at exponential rate. And I don't buy argument from people who are saying they are excited to live in this age. I can get that if that technology stopped at current state and remained to be just tools for our creative endeavours, but it doesn't seem to be an endgame here. Instead it aims to be a complete replace…
I see two ways this is going to go: 1. Universal Basic Income as we're on the way to a post-scarcity society. Unlikely to actually happen due to greed. 2. We take inspiration from the french revolution and then return to a simpler time.
Earlier quoted context omitted.
> Future robots may learn in their dreams... So prescient. I definitely think this will be a thing in the near future ~12-18 months time horizon
I may be wrong, but this seems to make no sense. A neural net can produce information outside of its original data set, but it is all and directly derived from that initial set. There are fundamental information constraints here. You cannot use a neural net to itself generate from its existing data set wholly new and original full quality training data for itself. You can use a neural net to generate data, and you ca…
There is an uncountably large number of models that perfectly replicate the data they're trained on; some generalize out of distribution much better. Something like dreaming might be a form of regularization: experimenting with simpler structures that perform equally well on training data but generalize better (e.g. by discovering simple algorithms that reproduce the data equally well as pure memorization but require simpler neural circuits than the memorizing circuits).
Once you have those better generalizing circuits, you can generate data that not only matches the input data in quality but potentially exceeds it, if the priors built into the learning algorithm match the real world.
Earlier quoted context omitted.
It's akin to us sending a rocket to space and immediately discovering a wormhole. Sure, there's a lot of science about what's out there, but to discover all this in our first few trips to orbit ...
Joscha Bach postulates that what we call consciousness must be something rather simple, an emergent property present in all sufficiently complex biological organisms. We don't inherit any software, so cognitive function must bootstrap itself from it's underlying structure alone. https://media.ccc.de/v/38c3-self-models-of-loving-grace
> We don't inherit any software
If you say that this is emergent from the "underlying structure alone", doesn't this mean that it would still be "inherited" software (though in this case, maybe we think of it like punch cards).