Live data from Hacker News

Robot will beam live Moon pictures to Oculus users

bbc.co.uk

21–26 of 26 posts

Re: Robot will beam live Moon pictures to Oculus users

#21

I work on that robot. There has never been a serious attempt to use an oculus to control it. Also, Daniel did not build any part of that robot and is trying to take credit for other people's work. The BBC refuses to contact the Robotics Institute at CMU or Astrobotic to verify any details in the story.

I was going to say that using an Oculus to move the robot on the moon would be a bad idea because of latency. Good to know that it's just shoddy reporting.

Re: Robot will beam live Moon pictures to Oculus users

#22

Earlier quoted context omitted.

I've thought about this a bit, but how can you achieve 360° stereo? If you have two 360° cameras side by side, as soon as you look 90° L/R, you no longer have depth and one eye would just see the side of the other camera. If you just have one 360° camera, you don't have any depth.

You could build a 360 degree 3D camera that works for any viewing configuration, but it would involve nontrivial image processing and wouldn't be totally free from small visual glitches/artifacts in some cases. 1. Build an array of a few (let's say 8 or so) cameras pointing outward from the center. 2. Use a stereo matching algorithm to extract a depth map from the perspective of each camera. Keeping track of the posi…

If you pair it with a laser scanner (which won't have any atmospheric interference to deal with on the moon!) you can get a near-perfect depth map without needing to do stereo correspondence (whose accuracy can be thrown off if there are identical features in nearby points - insert joke about all moon rocks looking the same). You could even throw a still DSLR with a telephoto lens on a perfectly calibrated, positionable mount, aim it at rocks in sequence, and get high-resolution textures. For bonus accuracy, have it so that the DSLR mount and the laser-scanner mount can swap positions, so you're getting the textures from the exact same position as the scanner. Send the depth map and textures back to Earth in non-real-time. Program the robot to autonomously explore regions where the depth map hasn't covered. Then on the client side, just feed those textures into a gaming engine or render farm. Bam. That would be a scalable Moon Explorer.

Re: Robot will beam live Moon pictures to Oculus users

#24

Earlier quoted context omitted.

I've thought about this a bit, but how can you achieve 360° stereo? If you have two 360° cameras side by side, as soon as you look 90° L/R, you no longer have depth and one eye would just see the side of the other camera. If you just have one 360° camera, you don't have any depth.

You could build a 360 degree 3D camera that works for any viewing configuration, but it would involve nontrivial image processing and wouldn't be totally free from small visual glitches/artifacts in some cases. 1. Build an array of a few (let's say 8 or so) cameras pointing outward from the center. 2. Use a stereo matching algorithm to extract a depth map from the perspective of each camera. Keeping track of the posi…

That's what I was hoping to see as well. Doing it on the moon is oddly enough probably easier than many earth locations due to the lack of complex foreground objects.

Re: Robot will beam live Moon pictures to Oculus users

#25
post #5

Presumably they’ve got a 360º camera module that’ll be proxied through an Earth-local server, rather than actually sending movement controls to a stereo camera on the lander? If nothing else the multi-second latency would be nauseating.

Really guys? It's so easy. Stream to earth local server with x minute delay, and Oculus users interact with local feed. No more latency. Really not difficult.

simple smart solution ;-)

Re: Robot will beam live Moon pictures to Oculus users

#26
post #17

An occulus is just a dual display device (ie 2 cameras video feeds need to be transmitted) There is no "beam" or magic. Its 2 cameras, 2 video feeds. That's great and exciting if as general public, we have access to those video feeds.

'Beam' is a common synonym for 'transmit'.

of course it is else it wouldn't make sense now would it. Synonyms don't have the same connotations.
Post reply on HN