Live data from Hacker News

Developer tools to create spatial experiences for Apple Vision Pro

apple.com

461–470 of 510 posts

Re: Developer tools to create spatial experiences for Apple Vision Pro

#461

Earlier quoted context omitted.

You can definitely hack iOS all you want to, use private APIs, do all sorts of things that are against the App Store rules, run it on your own device and publish the code to GitHub to let other hackers compile it and run it from source. iPhone enthusiasts Stephen Hackett (his real name), hack into pre-release versions of iOS all of the time to see how it’s running from their computer. Even that 1986 6th grade hacker…

Do tell me how I can run my own home screen, directly access the filesystem, write my own device driver or tweak the kernel without voiding my warranty and risking bricking my phone using a jailbreak exploit, assuming one is available for my device. This "you can build and directly deploy an app to a limited number of devices if you're on the developer program and have a mac, therefore you can 'hack iOS all you want'…

> voiding my warranty and risking bricking

nut up. hacking has never been perfectly safe and has never had a promise of easy. if you want it enough, you can make it happen.

Re: Developer tools to create spatial experiences for Apple Vision Pro

#462
post #449

Earlier quoted context omitted.

> but no gaze In the WWDC unity-metal demonstration they definitely seemed to have gaze tracking. Have you checked looked through the sdk and confirmed that there is no public way to do this?

Yah, its very easy to get confused by them chopping all the sessions up for the conference. It was a little frothy but my understanding now is Gaze is provided in both MR modes known as Bound and Unbound volumes. So look and click works fine. In bound volume you don't get head or hand pose or room geometry. In the Fully immersed VR mode you don't have gaze data for understandable privacy reasons although room geometr…

I don't think that tweet thread addresses gaze in particular? Is there a particular tweet I should be looking at or is it just asserting the (absolutely correct) assertion that it's confusing?

---

I'm specifically talking about the "Bring your Unity VR app to a fully immersive space" WWDDC talk, which claimed to be built on Metal and ArKit, and had a very very brief demo in it talking about gaze, screenshot here: https://media.hachyderm.io/media_attachments/files/110/520/9...

Note the demo wasn't actually on-device, and gaze was just following where the screen was pointing, so it's definitely possible I'm reading too much into this.

Re: Developer tools to create spatial experiences for Apple Vision Pro

#463

Earlier quoted context omitted.

3.5k device that's locked down into some iOS like Apple walled garden doesn't sound like backers playground to me.

> 3.5k device that's locked down into some iOS like Apple walled garden doesn't sound like backers playground to me. Some playgrounds have no fences, but also no interesting objects to play with. Other playgrounds have boundaries far out , and comes with a huge combinatorial explosion of possibility.

This. I'd rather play with Lego than throw rocks at a tree.

Re: Developer tools to create spatial experiences for Apple Vision Pro

#464

Earlier quoted context omitted.

Do tell me how I can run my own home screen, directly access the filesystem, write my own device driver or tweak the kernel without voiding my warranty and risking bricking my phone using a jailbreak exploit, assuming one is available for my device. This "you can build and directly deploy an app to a limited number of devices if you're on the developer program and have a mac, therefore you can 'hack iOS all you want'…

> voiding my warranty and risking bricking nut up. hacking has never been perfectly safe and has never had a promise of easy. if you want it enough, you can make it happen.

Piss off, I'll do my tinkering on a platform that isn't continually trying to prevent me from doing it, thank you very much. I'll use my expensive pocket bauble as the limited device it is designed to be. Just don't try and gaslight me into thinking it's in any sense a general purpose computer.

Re: Developer tools to create spatial experiences for Apple Vision Pro

#465
post #462

Earlier quoted context omitted.

Yah, its very easy to get confused by them chopping all the sessions up for the conference. It was a little frothy but my understanding now is Gaze is provided in both MR modes known as Bound and Unbound volumes. So look and click works fine. In bound volume you don't get head or hand pose or room geometry. In the Fully immersed VR mode you don't have gaze data for understandable privacy reasons although room geometr…

I don't think that tweet thread addresses gaze in particular? Is there a particular tweet I should be looking at or is it just asserting the (absolutely correct) assertion that it's confusing? --- I'm specifically talking about the "Bring your Unity VR app to a fully immersive space" WWDDC talk, which claimed to be built on Metal and ArKit, and had a very very brief demo in it talking about gaze, screenshot here: htt…

No I am sure they don't give you access to the Passthrough data or gaze details to the app in VR mode unless there are quite a few people wrong on this too. And since in VR you are completely outside the rendering subsystem I don't even know how you would interface whats in your app and the gaze hover trigger etc. My guess is the slide is referring to the MR unbound mode (full space they can call it to muddy the water). I would definitely be interested to know I am wrong here.

See this : https://twitter.com/Tojiro/status/1667028702734209025?t=1SnM...

EDIT: Checked with our team and so VR mode gaze has event triggers on any Apple UI object without exposing the details so that works unless your UI is not easily portable. And that's the same across all MR and VR modes.

Re: Developer tools to create spatial experiences for Apple Vision Pro

#466

I don't think there's a single comment here that's about the developer tools. It's all just people debating the merits of the Vision Pro and XR in general. Again...

I just came here to see if anyone else was having problems get it g the simulator working/ if anyone else had experienced the same error…

Re: Developer tools to create spatial experiences for Apple Vision Pro

#467
Exposure therapy would be huge. Existing exposure therapy apps have been run by people without phobias themselves and have shot themselves in the foot by advertising themselves with big vivid pictures of phobia scenarios guaranteeing that their target audience avoids them.

Re: Developer tools to create spatial experiences for Apple Vision Pro

#468

Earlier quoted context omitted.

Hand tracking is available on at least five other headsets available now.

I Haven’t seen hand tracking like the vision pro.

What you you mean by "like the Vision Pro"? The following headsets have hand tracking: Ques 2 & Pro PICO 4 HTC VIVE XR Elite Varjo XR-3

Re: Developer tools to create spatial experiences for Apple Vision Pro

#469

Earlier quoted context omitted.

New opportunities for abuse do exist with Vision Pro. If you allowed free reign access to the sensors people could record the inside of your house/work, capture your face, fingerprints, retinal pattern etc. And again with Objective-C it's impossible to prevent private API usage unless you have some sort of App Store model which can inspect the binaries and prevent abuse. So it's ultimately going to be the same as iOS…

> If you allowed free reign access to the sensors people could record the inside of your house/work, capture your face, fingerprints, retinal pattern etc. Yes, yes they could. That's not and shouldn't be Apple's problem. That's your workplace's problem to regulate how the device is used on-site, the government's problem to regulate how it can be used in public, your household's problem on how it can be used in privat…

Imagine if your Xerox machine refused to copy a bank note...

Re: Developer tools to create spatial experiences for Apple Vision Pro

#470

To paraphrase The Economist, "This device is amazing, and now Apple needs developers to figure out what it's for." https://www.economist.com/business/2023/06/06/apples-vision-...

Too many business/econ types have difficulty envisioning what new tech may be good for. Be it early computers, or the internet, or now this, they seem to be bottom-line people with little imagination or vision.
Post reply on HN