This might be relevant to the timing here: https://eletric-vehicles.com/waymo/waymo-exec-admits-remote-...
The Waymo World Model
41–50 of 699 posts
Re: The Waymo World Model
#42> The Waymo World Model can convert those kinds of videos, or any taken with a regular camera, into a multimodal simulation—showing how the Waymo Driver would see that exact scene. Subtle brag that Waymo could drive in camera-only mode if they chose to. They've stated as much previously, but that doesn't seem widely known.
The purpose of lidar is to prove error correction when you need it most in terms of camera accuracy loss. Humans do this, just in the sense of depth perception with both eyes.
(Always worth noting, human depth perception is not just based on stereoscopic vision, but also with focal distance, which is why so many people get simulator sickness from stereoscopic 3d VR)
Re: The Waymo World Model
#43> The Waymo World Model can convert those kinds of videos, or any taken with a regular camera, into a multimodal simulation—showing how the Waymo Driver would see that exact scene. Subtle brag that Waymo could drive in camera-only mode if they chose to. They've stated as much previously, but that doesn't seem widely known.
The purpose of lidar is to prove error correction when you need it most in terms of camera accuracy loss. Humans do this, just in the sense of depth perception with both eyes.
> Humans do this, just in the sense of depth perception with both eyes.
Humans do this with vibes and instincts, not just depth perception. When I can't see the lines on the road because there's too much slow, I can still interpret where they would be based on my familiarity with the roads and my implicit knowledge of how roads work, e.g. We do similar things for heavy rain or fog, although, sometimes those situations truly necessitate pulling over or slowing down and turning on your 4s - lidar might genuinely given an advantage there.
Re: The Waymo World Model
#44"Autonomous" https://cybernews.com/news/waymo-overseas-human-agents-robot...
This isn't news, they've always acknowledged that they have remote navigators that tell the cars what to do when they get stuck or confused. It's just that they don't directly drive the car.
Re: The Waymo World Model
#45Seems interesting, but why is it broken. Waymo repeatedly directed multiple automated vehicles into the private alley off of 5th near Brannan in SF even after being told none of them have any business there ever, period. If they can sense the weather and stuff then maybe they could put out a virtual sign or fence that notes what appears to be a road is neither a through way nor open to the public? I'm really bullish on automated driving long term, but now that vehicles are present for real we need to start to think about potentially getting serious about finding some way to get them to comply with the same laws that limit what people can do.
Re: The Waymo World Model
#46Earlier quoted context omitted.
The purpose of lidar is to prove error correction when you need it most in terms of camera accuracy loss. Humans do this, just in the sense of depth perception with both eyes.
> Humans do this, just in the sense of depth perception with both eyes. Humans do this with vibes and instincts, not just depth perception. When I can't see the lines on the road because there's too much slow, I can still interpret where they would be based on my familiarity with the roads and my implicit knowledge of how roads work, e.g. We do similar things for heavy rain or fog, although, sometimes those situation…
That’s the purpose of the neural networks
Re: The Waymo World Model
#47> The Waymo World Model can convert those kinds of videos, or any taken with a regular camera, into a multimodal simulation—showing how the Waymo Driver would see that exact scene. Subtle brag that Waymo could drive in camera-only mode if they chose to. They've stated as much previously, but that doesn't seem widely known.
The purpose of lidar is to prove error correction when you need it most in terms of camera accuracy loss. Humans do this, just in the sense of depth perception with both eyes.
Another way humans perceive depth is by moving our heads and perceiving parallax.
Re: The Waymo World Model
#48Still needs to be trained on the final boss: dense cities with narrow streets.
What would be an example city? Waymo just announced they're ramping up in Boston: https://waymo.com/blog/?modal=short-back-to-boston "we’re excited to continue effectively adapting to Boston’s cobblestones, narrow alleyways, roundabouts and turnpikes."
Not grandparent but I was rather thinking of medieval city centers in Italy or Spain.
edit: Case in point:
https://maps.app.goo.gl/xxYQWHrzSMES8HPL8
This is an alley in Coimbra, Portugal. A couple years ago I stayed at a hotel in this very street and took a cab from the train station. The driver could have stopped in the praça below and told me to walk 15m up. Instead the guy went all the way up then curved through 5-10 alleys like that to drop me off right right in front of my place. At a significant speed as well. It was one of the craziest car rides I've ever experienced.
Re: The Waymo World Model
#49> The Waymo World Model can convert those kinds of videos, or any taken with a regular camera, into a multimodal simulation—showing how the Waymo Driver would see that exact scene. Subtle brag that Waymo could drive in camera-only mode if they chose to. They've stated as much previously, but that doesn't seem widely known.
The purpose of lidar is to prove error correction when you need it most in terms of camera accuracy loss. Humans do this, just in the sense of depth perception with both eyes.
How expensive is their lidar system?
Re: The Waymo World Model
#50Still needs to be trained on the final boss: dense cities with narrow streets.
What would be an example city? Waymo just announced they're ramping up in Boston: https://waymo.com/blog/?modal=short-back-to-boston "we’re excited to continue effectively adapting to Boston’s cobblestones, narrow alleyways, roundabouts and turnpikes."
Any small city in Italy is going to be 10X more challenging than Boston