Live data from Hacker News

Jump – Experiences like you're actually there

google.com

111–120 of 199 posts

Re: Jump – Experiences like you're actually there

#111
post #61
post #52

Earlier quoted context omitted.

You sound like someone who hasn't tried Oculus Rift. In that case I'm happy to inform you that you're wrong.

I've tried the Rift, and I completely agree with him.

agree that oculus rift doesn't feel real? I own a rift too, and I don't understand how someone can easily say it doesn't feel real if they actually tried it. Sure it brings nausea sometimes, and sure a lot of the graphics are crappy, but can you so certainly say that it doesn't feel real? I haven't seen anyone who's tried oculus rift that say "huh how is this different from a video game, it's obvious it's fake"

Re: Jump – Experiences like you're actually there

#112

I love all the experimentation in this area but I'm afraid systems like this are going to fall into a sort of uncanny valley of VR. Your brain is incredibly good at picking out the discrepancies between the real world and a high-resolution 120fps image with surround sound - just as it is incredibly good at recognizing objects and motions masquerading as human. It's like going from 2D/24FPS to 3D/48FPS. You'd think it…

The problem with 48fps on the big screen was that it didn't feel "filmic". It actually WAS more realistic, but in that specific instance this actually hurt the message of the content. When we are recreating live events, concerts etc, we aren't going for filmic, we are going for the feeling of being there. I have tried the Paul McCartney example on GearVR which uses a similar technique as Jump - it's not perfect but it is a lot better than watching the concert on a screen.

TL;DR - We are approaching what we might want in a captured live experience, where early 48fps3d movie experiences may have passed what we want in a filmed one.

Re: Jump – Experiences like you're actually there

#114
post #4

Next up: Street View 3D?

It appears that someone has already done something like this [0]. In 2013 during 30C3 in Hamburg, someone bought in a bicycle which you used to bike through cities virtually using an Oculus rift [1]. Unfortunately I couldn't find any extra information about that project, but I do seem to remember that they had to cache everything locally because Google blocked them after 10000 API calls a day.

[0] https://github.com/troffmo5/OculusStreetView [1] https://instagram.com/p/ibU1IXFhCz/

Re: Jump – Experiences like you're actually there

#117
post #87

I'm curious how they are planning to record audio. Binaural sound can give a sense of presence even without video. The common approach to recording it is by placing microphones in your own or a fake heads ears and that won't work in VR. It'd be interesting to see an array of microphone elements perhaps in a cleverly shaped mold to go along with this.

The best idea-0 approach would be to record Ambisonics with a tetrahedral array, and ship B format or a derivative to the client.

In theory that could be processed just-in-time to produce an appropriate stereo image based on head tracking.

http://en.wikipedia.org/wiki/Ambisonics

In practice the computational overhead would likely be on par with graphics processing and you might want an APU :)

Re: Jump – Experiences like you're actually there

#118
post #108
post #60

Something that's maybe not clear from that page, but was mentioned in the Google IO keynote: this is not just stitching of multiple video streams. Google does some heavy-duty machine learning / computer vision on their servers to extract 3D information from these video streams (they mentioned having depth data). Then they presumably re-generate seamless stereoscopic 360-degree video from this 3D model. That's how the…

> get stereo from mono data Why do you call it mono data? Given how close are each lense from another, I'm guessing, that anything far enough (0.5m?) from the cameras is beign recorded by at least two cameras at all times.

Because simply stitching it will create one image/video stream from one perspective. If you have 2 eyes, you have stereo vision so can perceive depth. This technique allows for the synthesis of stereo video from a rig that doesn't directly capture stereo video. Pretty cool stuff

Re: Jump – Experiences like you're actually there

#119
post #90

Earlier quoted context omitted.

Well, if you have 16 quadcopters - each with one camera... :-)

or just one quadcopter, with one camera, that moves around the object

The comment I replied to mentioned a jumping whale, not exactly a still scene...
Post reply on HN