Live data from Hacker News

Camera vs. Lidar

scale.com

101–110 of 142 posts

Re: Camera vs. Lidar

#101

Some of this feels very cherry-picked. They’re comparing lidar vs camera on snapshots, when a model will always be continuously built as the scene changes. There’s also one instance where it gives lidar the advantage because it’s mounted on top of the car and can see over signs. What?!

Are they only utilizing one camera? Doesn't Tesla use multiple cameras and radar?

Seems like those shots were from just one camera.

Re: Camera vs. Lidar

#102

Earlier quoted context omitted.

I noticed that too. My understanding of what he said was most AV companies were using the lidar purely for localization (on an HD map) and not for object detection. This was the opposite of my understanding, so his statement was very confusing to me. Anyone able to comment?

You can absolutely use lidar pointclouds for object detection. It can be hard with low resolution lidar in a cluttered environment, though.

Of course you can use it. The claim Hotz seemed to be making was that the major AV stacks weren't doing it, which would have been major news to me.

Re: Camera vs. Lidar

#103
post #100

Earlier quoted context omitted.

Elon is an eternal optimist that truly believes that the tech will catch up with his goals.

To be fair, though: Elon is shipping actual vehicles. I mean, I think the GM and Waymo offerings look great too, but I can't buy one. Even granting the premise that LiDAR is going to be a firm requirement, it's not clear to me that Tesla is actually behind the curve on real products. Adding a LiDAR system (or buying one from Waymo) to a Tesla seems naively simpler than finishing and shipping a whole new system from s…

It does make me sad that Tesla didn't just throw all the (affordable?) tech they could into their cars, and then figure it out later.

Eg, it seems like they are taking the "figure it out later" approach, but they limited what they can work with to just camera information. Which to me is a shame. I'd like to see Tesla's model with lots of inputs.

Then again, I don't ship these cars, so I'm probably being ignorant :)

Re: Camera vs. Lidar

#104
post #13
post #7

Earlier quoted context omitted.

When I was younger I remember hearing about how we can do all these things because we have 2 eyes. And that depth perception is what gives us the ability to not walk into walls, and do other things including driving. I have thought about this many times and often wondered why when closing one eye I am still able to function. Sense then I have thought strongly that having depth perception is used for training some oth…

Fun trick: Look at a photograph with one eye closed. Your brain will do ... something and the picture will look 3d

That would be the same trick it does when you look at it with both eyes open...

Re: Camera vs. Lidar

#105
post #73
post #37

It’s always better to have multiple sensor modalities available. This is the main takeaway. Unsurprising but interesting nonetheless. I'm working in the field and it confirms my experience. However they have a big bias that need to be pointed out: [...] we must be able to annotate this data at extremely high accuracy levels or the perception system’s performance will begin to regress. Since Scale has a suite of data…

> taking consecutive frames (2D images) we can estimate per pixel depth Yeah, I find it odd that they're bringing up Elon's statement about LiDAR, but then completely ignore that they spoke about creating 3D models based on video. They even showed [0] how good of a 3d model they could create based on dat from their cameras. So they could just as well annotate in 3D. 0: https://youtu.be/Ucp0TTmvqOE?t=8217

Maybe I missed it, I only watched part of that 4 hour video, but why don't they do like humans do and geometrically construct a Z-buffer representation from 2 or more cameras.

Then you'd get all that sweet, sweet depth data that lidar provides but cheaper and at a much higher resolution.

Re: Camera vs. Lidar

#106
post #92

This article is only considering static images. Lidar static "images" necessarily contain depth information so yeah obviously they'll have better depth estimates. But that's really beside the point because the world is not static and any system attempting self-driving will need to take that into account. Using parallax measurements which is what Tesla says they are doing, you can dramatically increase the estimates o…

This was my question as well. How good are systems over a stream of data?

I am not expert in this field: how tracking actually works with a time dimension? These must be some sort of "state" carried over frame-by-frame? What is the "size" of this state? Objects just do not disappear and reappear for certain frames? This latter effect you can often see on many automatic labeling demos you find on GitHub.

Re: Camera vs. Lidar

#107

I think it's completely clear at this point that Tesla(or more specifically, Elon Musk) is just simply lying about what their cars will be able to do in the future with existing hardware. Don't get me wrong - the existing "autopilot" is fantastically good. But it's not going to jump from where it is now to full self driving, no matter how many years or millions are poured into it.

Elon is an eternal optimist that truly believes that the tech will catch up with his goals.

I honestly can't say if this is sarcasm or not.

Re: Camera vs. Lidar

#108
post #95

What if we have sensors/cameras/etc along the road and they feed data to whichever car is there? And if we also have cars share their sensor data? Would that speed things up in terms of achieving full autonomy?

Yes, drastically. But with it you bring new fears of how that data will be used by the government. You could also achieve something similar by forcing all vehicles to have embedded sensors that real time share data.

Are there any active research exploring this path? E.g. have cars to report about themselves or have a centralized control system (similar to air traffic control?)

Re: Camera vs. Lidar

#109
post #75

Earlier quoted context omitted.

The handover will be after the car stops because it’s confused. If there is no cell network or no operator available the car is simply stranded on the side of the road, just as after a mechanical failure. Operators can’t help “unknown situations” while moving.

In many places like bridges, hills, and congested city streets there is literally no road shoulder, no safe place to stop. When existing cars break down in those locations they end up blocking a traffic lane and frequently get hit from the rear by a drunk or distracted driver.

I had to drive once on a punctured tire that was deflating. No shoulders due to construction, and in fact I had to speed through the work zone to make sure I got to an exit while I still had some air.

The real world is a very very messy place.

Re: Camera vs. Lidar

#110

Earlier quoted context omitted.

there's 200-300k cars out there with just cameras + radar and their bet is the software catches up to the rhetoric. Adding lidar is next to impossible on the current fleet and adds to the cost if they start now. It is an early design bet which the coders now have to meet.

But no car sold yet (or in the coming decade) will have close to “full autonomy”. Not even close.

He’s been promising otherwise.
Post reply on HN