Live data from Hacker News

Firefox Reality Now Available

blog.mozilla.org

131–140 of 142 posts

Re: Firefox Reality Now Available

#131

Earlier quoted context omitted.

What is doing the speech-to-text processing? Is this part of the Common Voice project? Is the code available to use outside of Firefox Reality?

I checked and it's using Mozilla's DeepSpeech library: https://github.com/MozillaReality/FirefoxReality/blob/dee6f4... which is here: https://github.com/mozilla/DeepSpeech DeepSpeech is the actual voice recognition library, CommonVoice is a project to improve its accuracy by gathering more voice data.

Interesting. The DeepSpeech github indicates that it's not capable of realtime transcription, even using a GPU. How is that fast enough for this use case?

Re: Firefox Reality Now Available

#132
post #89

Earlier quoted context omitted.

Sure it does, because it is part of the GPU hardware acceleration stack. https://askubuntu.com/questions/491750/force-enable-hardware... On my case for the EEPC 1215B Brazos APU it worked, like everything in Linux there isn't a solution that makes all desktop users happy.

GPU hardware acceleration has nothing to do with video decode. (Okay, the hardware is often on the same physical silicon die, but they're separate things in software.) There is literally no support yet for any unix video decode APIs in Firefox. No VA-API, no VDPAU, no V4L2, no nothing. Here's the bug for VAAPI: https://bugzilla.mozilla.org/show_bug.cgi?id=1210727 There's a bounty for it: https://www.bountysource.com/…

Understood, then why did it help reducing the CPU load on rendering?

Re: Firefox Reality Now Available

#134

Hm, I don't get it. There is maybe a use case for VR to add immersion for games (like space sims or racing games), but why would I want to have a device on my head to look at a 2D canvas? I mean it's a nice tech demo, but it seems like the 2000ish hype around these 3D-cube window managers that ... looked cool, but otherwise don't add anything to your workflow. Do people really want to work (e.g. develop) with a VR in…

One of the biggest things we've found that people like to do in VR is private viewing. They'll collect links of videos all day and then come home to watch them on a "big screen" but don't have a laptop or TV that supports miracast, so use a VR headset. Or they like to watch twitch streamers or their favorite movie providers or just bounce around searching content. As the hardware becomes more mature, we'll support mo…

VR headsets are pretty awful at watching traditional 2D content though. And yeah, who buys an entire VR headsets because the don't have an HDMI cable or a Chromecast? This sounds implausible.

Re: Firefox Reality Now Available

#135
post #97

Is this just another Firefox OS? It strikes me as another side project they'll abandon later. I can understand Firefox OS, I wish they'd persevered, but I don't really get this. On its own I don't think this makes sense. Maybe in the context of an in game browser. But then who am I to comment.

I'll admit to not being particularly well-acquainted with VR, but a few observations:

1) This is being used as a target for Servo. Even if it ends up being useless (I won't pretend to be able to predict the future), the investigation into getting consistent 90+ FPS performance out of web rendering engines, regardless of content, is going to be excellent for the web. VR is a challenging environment for the Servo team to prove its technological prowess, and for many engineers, a challenging environment is exactly the kind of motivation necessary to push at boundaries.

2) Mozilla missed the "social" hype train and their mobile OS project was widely considered too little, too late (not to mention the terrible performance of mobile web engines at the time). Both of these areas are dominated by large, (effectively) proprietary vendors. Facebook's purchase of Oculus signaled to many that "social" was going to move to yet another platform. Mozilla's goal here is to get out in front of a potential VR hype train, keeping the open web as a major player in order to keep their mission relevant.

3) Mozilla believes the web is the ultimate platform for connecting people. It is one of the few markets with a political landmap that encourages collaboration between the multiple players. Therefore, for Mozilla, the capabilities of the web must always be expanded to prevent balkanization of the Internet into product-specific networks, such as Apple's iMessage. I am actually encouraged by their willingness to jump in front of VR, despite my own belief that VR won't be as relevant as many prognosticators think.

This is my analysis, take it with multiple grains of salt.

Re: Firefox Reality Now Available

#136
post #61
post #13

Earlier quoted context omitted.

> would be nice if it's not just a gimmick I mean, this is the future, right?

Don't you mean was the future? I have no idea what the current future is, all I know is that is doesn't include 3D TV sets and tablet computers replacing PCs (apparently, the PC can decline all on its own)

If I were to guess, I imagine room-sized VR is the next step.

Re: Firefox Reality Now Available

#137

Earlier quoted context omitted.

One of the biggest things we've found that people like to do in VR is private viewing. They'll collect links of videos all day and then come home to watch them on a "big screen" but don't have a laptop or TV that supports miracast, so use a VR headset. Or they like to watch twitch streamers or their favorite movie providers or just bounce around searching content. As the hardware becomes more mature, we'll support mo…

A $15 chromecast can easily enable this? I'm surprised this is an actual use case.

A $15 chromecast + a TV or monitor that someone may not have/want for whatever reason. A chromecast wouldn't be private either if you have other people in your household.

Re: Firefox Reality Now Available

#138

Earlier quoted context omitted.

I want to be working in VR. Once the resolution gets decent enough I can just get 20 screens wherever I look. Plus I can sit, stand, whatever. Sounds fantastic. Coffee might get a bit cumbersome though. A straw, maybe?

> Once the resolution gets decent enough I can just get 20 screens wherever I look. Isn't that stressful on your neck? In the current environment you can also have 20 screens and switch via key-combinations or using the mouse.

I think my ideal VR workspace would be one screen directly in front of me, and then as many screens as I want off in the distance.

You'd be able to easily see the screens in the distance and look for updates/etc and just click on it or whatever to pull that screen closer to you if you want to actually read on that screen.

Re: Firefox Reality Now Available

#139

Hm, I don't get it. There is maybe a use case for VR to add immersion for games (like space sims or racing games), but why would I want to have a device on my head to look at a 2D canvas? I mean it's a nice tech demo, but it seems like the 2000ish hype around these 3D-cube window managers that ... looked cool, but otherwise don't add anything to your workflow. Do people really want to work (e.g. develop) with a VR in…

> There is maybe a use case for VR to add immersion for games (like space sims or racing games), but why would I want to have a device on my head to look at a 2D canvas?

Virtual big screen (IIRC, not too many years ago headsets were sold for exactly that purpose, without even VR capability; they were basically like modern VR headsets burn without motion tracking.)

Post reply on HN