Live data from Hacker News

Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

news.ycombinator.com

21–30 of 35 posts

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#21

Intrigued by the number of patents you have, 200! I like to understand the process of submitting a simple one. Could you share costs and share process so I can get habit of attempting to submit one? Has any patents come to fruition in terms of royalties, $$, etc., do you mind sharing?

Yes, Proud to have Jill as my co-founder :)

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#22
post #17
post #5

No relation to vim then? I guess it's v for virtual and then "immerse".

"Ah, finally a VR platform where decent people (and otherwise) can immerse themselves in vim..." I thought to myself while deep inside me I knew it was destined to be a short road to disappointment and heartbreak.

Perhaps a new feature to add to our roadmap? :-)

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#23
post #2

This seems like a step in the right direction away from sphere-projected 'immersive' video. Very cool and can't wait for the 6dof VR player to be ready!

The motion parallx supported here makes it more natural to consume such content and when you drive the motion yourself (using our Vimmerse player) this takes you to a whole new level. For some content, you really feel that you are present there!

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#24
Maybe a bit in the weeds on the technical side ... but any reason you went with HLS vs. dash? I spent a good few years streaming video (2d) and my personal preference was HLS (mostly due to the intransigence of Apple and thereby its ubiquity) but a lot of people on the cutting edge of that field were hyping up dash. Was that a technical decision? I mean, I know of ways to support both in regular video (excepting the schism in DRM technologies) so I assume it must be technically possible to do it in 3d.

Also, just an FYI but Meta (nee Facebook) is doing the hard-press on LinkedIn for engineers with streaming experience specifically looking for AR/VR video streaming. How do you fit into that eco-system? Video is powerful because it is everywhere ... on Reddit, in my Facebook feed, on Instagram not to mention YouTube. It took a while for that to happen - but is there an on-ramp to similar services in your roadmap?

I've played a bit with 3d video, even bought a VR 180 camera. You mention one deficiency of VR 360 you sought to solve was that it lacked in degrees of freedom. My own experience was that VR 180 was significantly more interesting. I honestly don't want to swivel my head around much when consuming content and VR 180 at least keeps the majority of the action right in front of me. It feels more appropriate in many ways for many purposes, including a Zoom like VR conferencing setup. I would assume it uses less data as well which seems like a win.

Finally, AR feels like such an interesting area in this space. Do your formats include any kind of objects/meshes/shaders/etc? Now that I think about it, I'm even more interested in 3d spacial audio. Do either of these figure into your offering?

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#25

Maybe a bit in the weeds on the technical side ... but any reason you went with HLS vs. dash? I spent a good few years streaming video (2d) and my personal preference was HLS (mostly due to the intransigence of Apple and thereby its ubiquity) but a lot of people on the cutting edge of that field were hyping up dash. Was that a technical decision? I mean, I know of ways to support both in regular video (excepting the…

We went with HLS instead of DASH because of easier iPhone integration, but we can certainly offer DASH support if there is sufficient customer demand. Our technical approach works just as well for DASH as for HLS.

Because our approach is built on existing video streaming protocols/servers and video codecs, we think it is a straightforward step to add 3D video streaming to existing 2D video streaming services. As you say, 2D video is everywhere now. We envision a future where 3D video also becomes ubiquitous.

With our system, 180 or 360 cameras can be used. It is up the creator to decide what range of volume to capture, what type of cameras, how many cameras, etc., which determines the range of motion is supported for the viewer.

It is on our roadmap to allow augmentation of real-world 3D video with objects/meshes like in AR, except instead of augmenting your current local scene, you can augment a remote scene (or remote in time scene).

Spatial audio would also be a very useful feature. We are video experts, not audio experts, so would plan to work with a partner to offer support for spatial audio in the future.

Thanks for your comments. It's great to hear what features people are most interested in.

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#26
post #16

Congrats on the launch! I've been very interested in this field since the original Kinect came out and it was discovered you can easily get the raw RGB+D data over USB. I made a bunch of prototypes and had ambitious plans to make a depth-enabled short movie for my film school MA degree project, with a player on the original iPad and head tracking for a parallax effect. (A project much too ambitious; I never finished…

Thank you for the comment, actually we have recently captured some interesting content that will clearly demonstrate the potential of immersive video... Those are in the make so stay tuned to see what is coming next :) As long you have the passion, this means you are young (with experience on top) for the technology. Great feedback and if you still have the kinect DK around, you may even shoot and upload some content…

+1

We encourage you to shoot some content with a Kinect DK (or iPhone) and upload it to our platform to test it out yourself.

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#27

Will there be an Emacsmerse compatibility mode? ;) But more seriously (but still on the spirit of Emacs), how will your 3D video player be scriptable and extensible at runtime? I have some positive experience with extensible 3D panoramic stereo videos players, which I'd love to share with you: I developed a system for JauntVR that enables cross-platform scripting of Unity3D applications in JavaScript, for Jaunt's 3D…

I really wanted to do some great 3D interactive text in https://ayvri.com, but we learned in the process that you need to give the viewer a target or they loose context of what the text/menu/etc is attached to, or where it exists in the scene. The best way we found to do this was to use a 2D layer. I wanted to add some "flag" type animations, and do some other cool stuff in there, but we never got around to it.

I'm curious why you're recommending UnityJS instead of just a straight WebGL implementation.

Unity is an amazing tool, but my understanding is that the assets need to be packaged with the player, and that isn't done in real-time. So adding new functionality would mean either some of your videos don't have the full capabilities, or you're recompiling them.

We've been mostly out of this space for the last two years, so it's also possible that I'm entirely wrong about that.

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#28

Maybe a bit in the weeds on the technical side ... but any reason you went with HLS vs. dash? I spent a good few years streaming video (2d) and my personal preference was HLS (mostly due to the intransigence of Apple and thereby its ubiquity) but a lot of people on the cutting edge of that field were hyping up dash. Was that a technical decision? I mean, I know of ways to support both in regular video (excepting the…

I love this discussion... I second Jill in every thing she said. Our solution makes it straight forward to support immmersive video using legacy video servers (current infrastructure and bandwidth limits). Besides, we already have support for perspective and equirectangular projections and we plan to add more whenver there requests from creators / customers. Supporting MIV / Kinect / iPhones captures are just the begining and we definetly are going to add support for other volumetric representations in the future.

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#29
post #16

Congrats on the launch! I've been very interested in this field since the original Kinect came out and it was discovered you can easily get the raw RGB+D data over USB. I made a bunch of prototypes and had ambitious plans to make a depth-enabled short movie for my film school MA degree project, with a player on the original iPad and head tracking for a parallax effect. (A project much too ambitious; I never finished…

I'm curious why you are referring to 'Kinect'. And because I also agree that the website needs a lot of work to make it more obvious of what the software can actually do, I was wondering if you could answer me this:

Can their software measure depth and height? As in, if I take a 3D picture of an object, can it tell me the dimensions. As in, can this thing give me a computer model of a 3d object on my screen?

Re: Launch HN: Vimmerse (YC W22) – Platform and SDKs to create and play 3D video

#30
post #16

Congrats on the launch! I've been very interested in this field since the original Kinect came out and it was discovered you can easily get the raw RGB+D data over USB. I made a bunch of prototypes and had ambitious plans to make a depth-enabled short movie for my film school MA degree project, with a player on the original iPad and head tracking for a parallax effect. (A project much too ambitious; I never finished…

I'm curious why you are referring to 'Kinect'. And because I also agree that the website needs a lot of work to make it more obvious of what the software can actually do, I was wondering if you could answer me this: Can their software measure depth and height? As in, if I take a 3D picture of an object, can it tell me the dimensions. As in, can this thing give me a computer model of a 3d object on my screen?

We are referring the Microsoft Azure Kinect DK depth sensor. https://azure.microsoft.com/en-us/services/kinect-dk/

No, our system doesn't measure object dimensions. It provides the ability to capture a real-world scene and stream it for remote playback in which the viewer has the ability to control navigation around the scene.

Post reply on HN