Project Genie: Experimenting with infinite, interactive worlds
201–210 of 347 posts
Re: Project Genie: Experimenting with infinite, interactive worlds
#202Earlier quoted context omitted.
Since a hot take is as good as the next one: LLMs are by the day more and more clearly understood as a "local maximum" with flawed capabilities, limited efficiency, a $trillion + a large chunk of the USA's GDP wasted, nobody even turning a profit from that nor able to build something that can't be reproduced for free within 6 months. When the right move (strategically, economically) is to not compete, the head of the…
You really need to be obstinate in your convictions if you can dismiss LLMs at the time when everyone's job is being turned around by them. Everywhere I look, everyone I talk to, is using LLMs more and more to do their job and dramatically increase their productivity. It's one of the most successful technologies I've ever witnessed arriving on the market, and it's only just started- it's just three years old.
Re: Project Genie: Experimenting with infinite, interactive worlds
#203Re: Project Genie: Experimenting with infinite, interactive worlds
#204Re: Project Genie: Experimenting with infinite, interactive worlds
#205Now I can't stop thinking about _The Experience Machine_ by Andy Clark. It theorizes that this is how humans navigate and experience the real world: Our brains generate what we think the world around is like and our senses don't so much directly process visual information but instead act like a kind of loss function for our internal simulations. Then we use that error to update our internal model of the world. In thi…
I think this is pretty well established as far as neurologists are concerned and explains a lot of things. Like dreaming for instance.. just something like the model running without sensory input constraining it.
Re: Project Genie: Experimenting with infinite, interactive worlds
#206Now I can't stop thinking about _The Experience Machine_ by Andy Clark. It theorizes that this is how humans navigate and experience the real world: Our brains generate what we think the world around is like and our senses don't so much directly process visual information but instead act like a kind of loss function for our internal simulations. Then we use that error to update our internal model of the world. In thi…
It’s also easy to find this treated in various philosophy/religion through time and space. And anyway as consciousness is eager to project whatever looks like a possible fit, elements of suggesting prior arts can be inferred back as far as traces can be found.
Re: Project Genie: Experimenting with infinite, interactive worlds
#207Earlier quoted context omitted.
You really need to be obstinate in your convictions if you can dismiss LLMs at the time when everyone's job is being turned around by them. Everywhere I look, everyone I talk to, is using LLMs more and more to do their job and dramatically increase their productivity. It's one of the most successful technologies I've ever witnessed arriving on the market, and it's only just started- it's just three years old.
What are you seeing people do with it? To my eyes everyone is in the same amount of meetings lol.
Non-developers I know use them to organise meetings, write emails, research companies, write down and summarise counselling sessions (not the clients, the counselor), write press reports, help with advertising campaigns management, review complex commercial insurance policies, fix translations... The list of uses is endless, really. And I'm only talking of work-related usage, personal usage goes of course well beyond this.
Re: Project Genie: Experimenting with infinite, interactive worlds
#208Earlier quoted context omitted.
> Why are they not training models to help write games instead? Genie isn't about making games... Granted, they for some reason they don't put this at the top. Classic Google, not communicating well... | It simulates physics and interactions for dynamic worlds, while its breakthrough consistency enables the simulation of any real-world scenario — from robotics and modelling animation and fiction, to exploring locatio…
But it's not simulating, is it? It's hallucinating videos with an input channel to guide what the video looks like. Why do that instead of just picking Unreal, Unity, etc and having it actually simulated for a fraction of the effort?
I think it really comes down to dev time and adaptability. But honestly I'm fairly with you. I don't think this is a great route. I have a lot of experience in synthetic data generation and nothing beats high quality data. I do think we should develop world models but I wouldn't all something a world model unless it actually models a physics. And I mean "a physics" not "what people think of as 'physics'" (i.e. the real world). I mean having a counterfactual representation of an environment. Our physics equations are an extremely compressed representation of our reality. You can't generate these representations through observation alone, and that is the naive part of the usual way to develop world models. But we'd need to go into metaphysics and that's a long conversation not well suited for HN.
These simulations are helping but they have a clear limit to their utility. I think too many people believe that if you just feed the models enough data it'll learn. Hyperscaleing is a misunderstanding of the Bitter Lesson that slows development despite showing some progress.
Re: Project Genie: Experimenting with infinite, interactive worlds
#209Everyone here seems too caught up in the idea that Genie is the product, and that its purpose is to be a video game, movie, or VR environment. That is not the goal. The purpose of world models like Genie is to be the "imagination" of next-generation AI and robotics systems: a way for them to simulate the outcomes of potential actions in order to inform decisions.