I've read claims that they are desperately trying to hire.
https://mobile.twitter.com/TaylorOgan/status/140705191831739...
Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
11–20 of 214 posts
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#12tldr: Tesla uses vision alone, and has dropped radar and the other sensor. He makes a very decent argument why. (Surprisingly, he basically ignores night driving.)
Ironically this is what Tesla criticized Mobileye for.
I still think that this is far the best demonstration of autonomous driving to date https://youtu.be/A1qNdHPyHu4
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#13I've read claims that they are desperately trying to hire. https://mobile.twitter.com/TaylorOgan/status/140705191831739...
Maybe it’s an unfortunate side effect of their success. Almost all early members of the team are now multi millionaires if they held their stock.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#14It's interesting that an academic conference now feels like a marketing op for industrial research labs more than anything. His claims about how accurate their vision system is and how it is exceeding other sensors is not verifiable in any way to the public. Given how well qualified he is I am sure he is not wrong! Andrej is brilliant. But this is an academic conference right? This isn't open science, it's a discussi…
In the talk, he gave clear examples with detailed position + velocity graphs where the vision system detected obstacles sooner and with less jitter than the radar system. Specifically the overpass where radar triggers erroneous braking, and the pulled over truck where radar detects the obstacle significantly slower.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#15I've read claims that they are desperately trying to hire. https://mobile.twitter.com/TaylorOgan/status/140705191831739...
Anecdata but both of the people I know that worked on Autopilot quit within 18 months of starting, citing extreme overwork and Musk micromanaging things. This lines up with that.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#16I like Andrej from his PhD research days and awesome blog posts but this is a series of disasters in the making, that is until FTC steps in after more people die from “self-driving” accidents under interesting and unexpected circumstances. The whole vision vs. LIDAR stuff is a distraction as long as Tesla “AI” doesn’t have common sense. It literally doesn’t know what it’s doing, and the tail of edge cases to "fit" th…
There are two fundamental reasons, in principle, vision alone can do it: 1) Humans do it with vision alone 2) You can actually predict lidar’s output with vision alone. So many systems out there actually use lidar to generate more labeled data to make lidar unnecessary
besides vision, humans also have this thing called brain, and reasoning, and instincts, and being able to tell if the object in front of them is e.g. a roof of an overturned truck vs. empty space, etc, etc.
the key word is "etc" which expands into infinite tail, which no big data training on farms of GPUs would ever help with.
Humans and other animals have an ability to understand the scene and generalize from prior experiences to infinite set of new and unexpected circumstances, the "common sense" these dumb curve-fitting models are fundamentally lacking.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#17He made a very good argument for vision-only, but it seems like training actually uses radar data to help calibrate vision measurements, so it seems to me there’s value in making some vehicles still contain radar (say, one out of 10) even if it’s not used for controlling the vehicle directly at drive time.
Also, the sensor resolution issue he mentioned could be addressed by using a higher resolution radar sensor.
I find the list of 221 triggers to be interesting. In principle, the NHTSA or NTSB could help contribute lists of triggers to companies to validate their training sets on.
Every time there is a fatal airliner accident, the NTSB does a safety investigation and airliners get a little bit safer each time. In the same way, each fatal accident in a vehicle with this kind of autonomy could end up being captured by these triggers, improving safety over time in a sort of mixture between expert human analysis and ML.
(Nobody does this for all regular car crashes because fatal car crashes happen every day! And you’re not going to retrain human drivers about some new edge case every day, although you can for vehicles like this.)
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#18I like Andrej from his PhD research days and awesome blog posts but this is a series of disasters in the making, that is until FTC steps in after more people die from “self-driving” accidents under interesting and unexpected circumstances. The whole vision vs. LIDAR stuff is a distraction as long as Tesla “AI” doesn’t have common sense. It literally doesn’t know what it’s doing, and the tail of edge cases to "fit" th…
There are two fundamental reasons, in principle, vision alone can do it: 1) Humans do it with vision alone 2) You can actually predict lidar’s output with vision alone. So many systems out there actually use lidar to generate more labeled data to make lidar unnecessary
There are many things humans do with vision alone that machines can't. For instance see if a person standing 50 ft away is looking at you or at the house behind you.
The human vision system operates at a bitrate equivalent of well beyond 500 gigabits per second. Resorting to "humans can do it with vision alone" is only a sufficient argument if your computer vision system can match that.
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#19I like Andrej from his PhD research days and awesome blog posts but this is a series of disasters in the making, that is until FTC steps in after more people die from “self-driving” accidents under interesting and unexpected circumstances. The whole vision vs. LIDAR stuff is a distraction as long as Tesla “AI” doesn’t have common sense. It literally doesn’t know what it’s doing, and the tail of edge cases to "fit" th…
[deleted]
Re: Andrej Karpathy (Tesla): CVPR 2021 Workshop on Autonomous Vehicles [video]
#20I like Andrej from his PhD research days and awesome blog posts but this is a series of disasters in the making, that is until FTC steps in after more people die from “self-driving” accidents under interesting and unexpected circumstances. The whole vision vs. LIDAR stuff is a distraction as long as Tesla “AI” doesn’t have common sense. It literally doesn’t know what it’s doing, and the tail of edge cases to "fit" th…
>common sense
What a ridiculously useless term.