Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Beyond the pixel plane: sensing and learning in 3D

thegradient.pub

Post reply on HN
Print view View original

11–16 of 16 posts

Re: Beyond the pixel plane: sensing and learning in 3D

#11

Post by jcims »

gtmtg wrote: post #5
bitL wrote: post #3

Earlier quoted context omitted.

Super cool course! Thanks for the link! Do you know what are the most precise programmable RGB-D cameras a non-professional can buy? I was trying to extract 3D information just from a single camera via 3D convolutions and RNNs (for a self-driving car project) and would like to play with real 3D a bit as well.

(I wrote the original article) I've been playing around with a few and I'd recommend the Orbbec Astra and the Intel RealSense (the new D435 is what I've been using) as decent but cheap cameras if you want to get started! The Asus Xtion PRO LIVE is also quite good but since it's been discontinued it's pretty hard to find. The Stereolabs ZED relies on stereo vision but produces a similar output as traditional RGB-D cam…

Any idea if the iPhone X surfaces RGBD from the TrueDepth camera?

Re: Beyond the pixel plane: sensing and learning in 3D

#12

Post by gtmtg »

jcims wrote: post #11
gtmtg wrote: post #5

Earlier quoted context omitted.

(I wrote the original article) I've been playing around with a few and I'd recommend the Orbbec Astra and the Intel RealSense (the new D435 is what I've been using) as decent but cheap cameras if you want to get started! The Asus Xtion PRO LIVE is also quite good but since it's been discontinued it's pretty hard to find. The Stereolabs ZED relies on stereo vision but produces a similar output as traditional RGB-D cam…

Any idea if the iPhone X surfaces RGBD from the TrueDepth camera?

Yes! Haven’t had a chance to play around with it but I’ve been wanting to. See AVDepthData: docs at https://developer.apple.com/documentation/avfoundation/avdep... and reference implementation for streaming depth at https://developer.apple.com/documentation/avfoundation/camer...

Re: Beyond the pixel plane: sensing and learning in 3D

#13

Post by MrQuincle »

gtmtg wrote: post #5
bitL wrote: post #3

Earlier quoted context omitted.

Super cool course! Thanks for the link! Do you know what are the most precise programmable RGB-D cameras a non-professional can buy? I was trying to extract 3D information just from a single camera via 3D convolutions and RNNs (for a self-driving car project) and would like to play with real 3D a bit as well.

(I wrote the original article) I've been playing around with a few and I'd recommend the Orbbec Astra and the Intel RealSense (the new D435 is what I've been using) as decent but cheap cameras if you want to get started! The Asus Xtion PRO LIVE is also quite good but since it's been discontinued it's pretty hard to find. The Stereolabs ZED relies on stereo vision but produces a similar output as traditional RGB-D cam…

Thanks for the article. It is well written.

You promise some directions for fruitful research. It is a bit light on that. Maybe it's nice to expand on that topic a bit more.

Re: Beyond the pixel plane: sensing and learning in 3D

#14

Post by jeffchuber »

bitL wrote: post #3
jeffchuber wrote: post #2

This is a great overview. Also checkout CS 468 from Stanford, http://graphics.stanford.edu/courses/cs468-17-spring/ "Machine Learning for 3D Data" Also, if you want to work on this stuff full time- https://news.ycombinator.com/item?id=17649726

Super cool course! Thanks for the link! Do you know what are the most precise programmable RGB-D cameras a non-professional can buy? I was trying to extract 3D information just from a single camera via 3D convolutions and RNNs (for a self-driving car project) and would like to play with real 3D a bit as well.

Not workable for a self-driving car - but for other applications the iPhone X has a front-facing RGB-D sensor.

Re: Beyond the pixel plane: sensing and learning in 3D

#15

Post by jeffchuber »

jcims wrote: post #11
gtmtg wrote: post #5

Earlier quoted context omitted.

(I wrote the original article) I've been playing around with a few and I'd recommend the Orbbec Astra and the Intel RealSense (the new D435 is what I've been using) as decent but cheap cameras if you want to get started! The Asus Xtion PRO LIVE is also quite good but since it's been discontinued it's pretty hard to find. The Stereolabs ZED relies on stereo vision but produces a similar output as traditional RGB-D cam…

Any idea if the iPhone X surfaces RGBD from the TrueDepth camera?

Yes

Re: Beyond the pixel plane: sensing and learning in 3D

#16

Post by mncharity »

gtmtg wrote: post #9
glalonde wrote: post #8

What about pose estimation? e.g. Given a well defined coordinate system, like the origin is the nose on a face, determine the pose of the face. Is this still best done with classic optimization formulations like ransac/ICP and a supplied model, or have these been bested by learned models somehow?

Don't think it's exactly what you're talking about (I'm sure there are other works much closer to what you have in mind, just can't recall off the top of my head) — but you might find PoseNet ( https://www.cv-foundation.org/openaccess/content_iccv_2015/p... ) interesting. Not explicitly 3D, but estimates where in a large-scale scene a picture was taken using an end-to-end convolutional network. With that said, I thin…

PoseNet on Tensorflow.js does nice head tracking. One can get rough head pose from nose/eyes/ears. but it's crufty.

[1] Web-browser demo: https://storage.googleapis.com/tfjs-models/demos/posenet/cam... [2] Github: https://github.com/tensorflow/tfjs-models/tree/master/posene...

Post reply on HN