Earlier quoted context omitted.
> solving the last 1% of this using only vision likely requires a general artificial intelligence That is likely close to true with lidar as well. See also some of Waymo's recent struggles in unexpected construction zones. Maybe lidar helps in getting there, but I'm afraid they all hit a pretty tough ceiling without this.
> That is likely close to true with lidar as well. See also some of Waymo's recent struggles in unexpected construction zones. That example has nothing to do with lidar, but with planning. The car was able to detect the construction zone just fine.
Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
191–200 of 214 posts
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#192Earlier quoted context omitted.
When was last time you looked at LIDAR tech? It's already cheap enough that it can be easily deployed in millions of cars.
Hi-def 360 LIDAR that companies like Waymo or Aurora are absolutely not ready to put into millions of vehicles for a price that makes it anywhere close to reasonable. Multiple companies that have announced Lidar have later removed it for the cars. The Lidar that are actually currently deployed that you can 'just' get from suppliers is of the not of the same quality and we have yet to actually see real high volume car…
People keep getting hung up on their vision strategy because it sharply diverges from that of all other players, but it's really just tackling the "no one knows how to do this and no one really tries" part of the problem first.
No level 5 autonomous driving system will ever ship without really good computer vision.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#193Earlier quoted context omitted.
> LiDAR doesn’t tell you that it’s a bag on the road vs a raccoon I think that's largely an issue with the early LIDAR devices today, but not necessarily what may be to come. There's something to be said about measuring actual data with solid physics vs. inferring distances with billions of operations on RGB data. If you were landing a commercial aircraft in fog, you most certainly don't rely on your eyes to do most…
It’s easy to add a few hundred thousand dollars of sensors to a $100 million plane. But $20k on a $40k car is too much and makes it cost prohibitive for most people. If vision alone can get you to say 1 crash in 10 million miles, that’s more than good enough to replace human drivers. If someone decides they want to go the extra mile and will pay for something rated for 1 in 20 million miles for 2x the cost, then they…
> You don’t need to do things in one shot and get to the finish line.
I think we agree on these things. I wasn't trying to dispute their approach, rather explain their rationale for their current method, which is focused at actually selling product now.
> But $20k on a $40k car is too much
Those sensors don't need to be 20K-40K, they just aren't mass produced yet. That's why I think Elon Musk will change his tune in some years when those sensors are 1/100 the cost and 10X more accurate than vision.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#194Earlier quoted context omitted.
The vision-only strategy only made a shred of sense before high performance / low cost LIDARs like the Ouster OS1 became available. Now it’s an indefensible position on safety or economic grounds.
LIDAR in a drizzly city like Seattle is of minimal value so the system has to fallback to vision only anyways
Obviously, pure vision is a viable system, as it's what we as humans use. The question remains as to whether or not it will be comparable to more precise LiDAR based systems in the near future.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#195Even if FSD takes longer, I sure am glad about the active safety features to prevent dumb incidents. Hope that trickles to every other manufacturer petrol/electric
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#196Earlier quoted context omitted.
What models on the market use 4D imaging radars? All info I can find shows products releases in the past 1-2 years for future vehicles.
https://arberobotics.com/product/ is one. It was rumored Tesla themselves wanted to use Arbe radars, but evidently they have ditched the plan and gone radar less. I think AutoX from China is planning to use Arbe as well. Waymo has its own custom developed 4D imaging radar and I imagine most of the other SDC players have their own versions.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#197Earlier quoted context omitted.
https://arberobotics.com/product/ is one. It was rumored Tesla themselves wanted to use Arbe radars, but evidently they have ditched the plan and gone radar less. I think AutoX from China is planning to use Arbe as well. Waymo has its own custom developed 4D imaging radar and I imagine most of the other SDC players have their own versions.
Sounds like “none”.
[1] https://blog.waymo.com/2020/03/introducing-5th-generation-wa...
[2] https://aurora.tech/technology/driver
[3] https://www.mobileye.com/blog/radar-lidar-next-generation-ac...
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#198Earlier quoted context omitted.
Sorry at (1) yield means yield. Maybe it shouldn't have stuck the nose so far out, but yeah you have to wait until proper gap in the traffic. The non-accelerating to highway speed is the real bug though.
There WAS a proper gap in traffic if the car used its accelerator on the ramp. The car would not have impeded the truck at all if it drove the ramp faster. This is an incredibly common issue with autonomous systems: anticipation of other vehicles with an awkward angle of attack, which is common while merging or while other cars are merging. Also, autonomous systems also tend to be way too cautious, which is incredibl…
No. A good driver stops at the yield sign if an approaching vehicle is 2-3 car lengths away. It is dangerous to play guessing games with your car's engine and another driver's attention. If anything goes wrong (tire puncture, engine dies, slippery road, truck driver slams the gas) you have successfully managed to put yourself into the direct path of a speeding brick wall 5x as heavy as you. There is never a safe merging scenario where the right choice is to slam the gas pedal to beat another driver to the punch, especially not when merging onto an active freeway.
If there is a yield sign at the end of the onramp, that means prepare to yield. If there is not a yield sign, then the expectation is to keep merging. There wouldn't be a point to the yield sign if everyone treated it as if it didn't exist.
> leaves its front end sticking out into the oncoming traffic,
I also agree with you but this may be a byproduct of the camera's perspective and maybe it would look normal in the driver's seat. We don't really have a great view but the truck could also have been hugging the curb which would have brought it closer to the car than it should be.
> dangerously merges sheepishly without accelerating fast enough
Fully agree here. If you merge you have to commit to matching the speed of nearby vehicles or else you're creating a dangerous situation. Mobileye should have sped up much faster than it did.
I'm not a neural network, fwiw.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#199Earlier quoted context omitted.
I didn't even see this comment before you edited it. Please don't pull tricks like this.
Tricks? You detached a perfectly valid thread. Kathpathy only responded to this thread with a shallow dismissal and none of the other critiques. That should tell you something.
If you have a problem with, or a question about, why I moderated the thread a certain way, that's of course fine, but a different issue.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#200Earlier quoted context omitted.
There WAS a proper gap in traffic if the car used its accelerator on the ramp. The car would not have impeded the truck at all if it drove the ramp faster. This is an incredibly common issue with autonomous systems: anticipation of other vehicles with an awkward angle of attack, which is common while merging or while other cars are merging. Also, autonomous systems also tend to be way too cautious, which is incredibl…
> A good driver accelerates on that ramp on beats the truck by 2-3 car lengths and merges at speed No. A good driver stops at the yield sign if an approaching vehicle is 2-3 car lengths away. It is dangerous to play guessing games with your car's engine and another driver's attention. If anything goes wrong (tire puncture, engine dies, slippery road, truck driver slams the gas) you have successfully managed to put yo…
https://i.imgur.com/irkHBxc.png
I think people lower their expectations for autonomous systems. Driving the ramp at a speed a human would and taking that obvious gap to zipper-merge is the correct maneuver for a human. Perhaps you want the autonomous system to err on the side of caution, but I'm actually trying to hold it to a human standard.
But yeah, at the very least, don't get confused and sit there with your nose out in traffic. What's really scary is that this is the take Mobileye chose to go with. They probably had dozens more, with even worse blunders.