Always wondered if dreaming is some kind of daily memory consolidation function. Logged short-term/episodic memory being filtered and the important bits baked by replaying in a limited simulacrum.
There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
That's the wake sleep algorithm for undirected graphical models.
Hinton had a course on Coursera around 2015 that covered a lot of pre NN deep learning. Sadly I don't think it's up anymore.
Really great to see this released! Some interesting videos from early-access users: - https://youtu.be/15KtGNgpVnE?si=rgQ0PSRniRGcvN31&t=197 walking through various cities - https://x.com/fofrAI/status/2016936855607136506 helicopter / flight sim - https://x.com/venturetwins/status/2016919922727850333 space station, https://x.com/venturetwins/status/2016920340602278368 Dunkin' Donuts - https://youtu.be/lALGud1Ynhc?si=…
These are extremely impressive from a technological progression standpoint, and at the same time not at all compelling, in the same way AI images and LLM prose are and are not. It's neat I guess that I can use a few words and generate the equivalent of an Unreal 5 asset flip and play around in it. Also I will never do that, much less pay some ongoing compute cost for each second I'm doing it.
Yeah, the future I see from this is just shitty walking video games that maybe look nice but have ridiculous input lag, stuttery frame rates, and no compelling gameplay loop or story. Oh and another tool to fill up facebook with more fake videos to make people angry. Oh well, I guess this is what we've decided to direct all our energy towards.
I have been confused for a long time why FB is not motivated enough to invest in world models, it IS the key to unblock their "metaverse" vision. And instead they let go Yann LeCun.
LeCun wasn't producing results. He was obstinate and insistent on his own theories and ideas which weren't, and possibly aren't, going anywhere. He refused to engage with LLMs and compete in the market that exists, and spent all his effort and energy on unproven ideas and research, which split the company's mission and competitiveness. They lost their place as one of the top 4 AI companies, and are now a full generat…
It's insane that you can argue this in a world where facebook continues to be state of the art (and it's not even close) on semantic segmentation. Those SAM models they produce deliver more value than a hypothetical competitive llama5 model coming out tomorrow.
I'm banning my wife from ever buying any Alexander Wang clothing, because his leadership is so poor in comparison that he's going to also devalue the name-collision fashion brand that he shares a name with. That's how bad his leadership is going to be in comparison to Yann. Scale AI was only successful for the same reason Langchain was. Easy to be a big fish in a pond with no other fishes.
The more of this I see the more I want to spend time away from screens and doing those things I love to do in the real world.
The more I see of this, the faster I want it to go! I'm developing filmmaking tools with World Labs' Marble world model: https://www.youtube.com/watch?v=wJCJYdGdpHg https://github.com/storytold/artcraft I think we'll eventually get to the point where these are real time and have consistent representations. I've been excited about world models since I saw the in-the-browser Pokemon demo: https://madebyoll.in/posts/gam…
I dunno, this all just looks like...garbage? And tools to help generate that garbage faster.
The subscribers to simulations from the pr0n-industry and the billions of lonely humanoids will suffocate in their VR-headsets, if we don't think about sensors to watch their oxygen-levels.
If only Google had the technology for game streaming... Oh wait RIP Stadia.
Stadia was lightyears ahead, but pro-Microsoft media assassinated it with FUD While "journalists" were busy bootlicking a laggy 720p Android only xCloud beta, Stadia was already delivering flawless 4K@60FPS in a web browser They killed the only platform that actually worked just to protect Microsoft This will be a textbook case study in how a legacy monopoly kills innovation to protect its own mediocrity Microsoft wo…
I remember a video where they went through scyscrapers zooming into a room, where life was moving on and there was a screen inside a room and there was something running on it. I never understood how this was tanked. It was revolutionary.
There was once a neural network that used dreaming phases for regularisation. It would run in reverse on random data and whatever activated was down–weighted.
That's the wake sleep algorithm for undirected graphical models. Hinton had a course on Coursera around 2015 that covered a lot of pre NN deep learning. Sadly I don't think it's up anymore.
I think this is pretty well established as far as neurologists are concerned and explains a lot of things. Like dreaming for instance.. just something like the model running without sensory input constraining it.
Could you please give some sources - books or articles or videos on that topic? It's really fascinating
Best case, Google DeepMind cracks AGI by letting agents learn for themselves inside simulated worlds. Worst case, they've invented the greatest, most expensive screensaver generator in human history.
Could you explain how AGI is a best case? Last time I checked, "if anyone builds it everyone dies".
The actual breakthrough with Genie is being able to turn around and look back, and seeing the same scene that was there before. A few other labs have similar world simulators, but they all struggle badly with keeping coherence of things not in view. Hence why they always walk forwards and never look around.
Can they? Is there a video of someone standing in place and spinning the camera 1080 degrees?