Show HN: I built an interactive cloth solver for Apple Vision Pro

#1

Post by lukko » Fri, May 31, 2024, 8:23 PM UTC

A bit more context - the cloth sim is part of my app, Lungy (https://www.lungy.app). It's designed to be an active meditation / relaxation app, so you can play relaxing instruments in space and immersive breathing exercises. The original Lungy is a breathing app available for iOS, that uses real-time breathing with interactive visuals.

The cloth sim is a Verlet integration, running on a regular grid. For now, I have tried a couple of different cloth scenes - a sort of touch reactive 'pad', where different parts of the cloth are mapped to different sounds and a cloth that blows in sync with breathing. The collision detection is a little bit tricky with the deforming mesh, but seems to work ok overall. Overall, it seems like a cool interaction to explore.

The cloth sim is live on the app store now (and free) - would love to hear feedback from anyone with a Vision Pro.

App Store (Vision Pro): https://apps.apple.com/app/id6470201263

Lungy, original for iOS - https://apps.apple.com/app/id1545223887

Show HN: I built an interactive cloth solver for Apple Vision Pro
youtube.com

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#2

Post by [deleted] » Fri, May 31, 2024, 8:27 PM UTC

[deleted]

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#3

Post by jncfhnb » Sat, Jun 01, 2024, 7:50 PM UTC

It seems weird that the interface seems to encourage interacting with it from afar and has no indicators as to where your actions would affect it (like a highly on a pickupable node). Is there some sort of intuitive reason for that that’s not obvious on a video? Not a complaint just curious.

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#4

Post by kromokromo » Sat, Jun 01, 2024, 8:38 PM UTC

From the title I thought you made a optical recognition system for sorting out the laundry, finding sock pairs etc.

Very cool sim, but kind of disappointed still. Will build this someday.

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#5

Post by [deleted] » Sat, Jun 01, 2024, 8:38 PM UTC

[deleted]

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#6

Post by lukko » Sat, Jun 01, 2024, 8:47 PM UTC

jncfhnb wrote: post #3

It seems weird that the interface seems to encourage interacting with it from afar and has no indicators as to where your actions would affect it (like a highly on a pickupable node). Is there some sort of intuitive reason for that that’s not obvious on a video? Not a complaint just curious.

Good point - I should have probably shown the direct interaction too (touching the actual fabric in space) - there's a gif here: https://jmp.sh/s/lHqJm6NEvqMqkXMPyUpZ. It was a little but laggy when also screen recording on device.

In the video I am looking at where I want to interact and then using a pinch gesture and the sounds are mapped to different cells of the cloth. By either looking and tapping, or playing directly you can hopefully play your intended sound.

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#7

Post by lukko » Sat, Jun 01, 2024, 8:48 PM UTC

kromokromo wrote: post #4

From the title I thought you made a optical recognition system for sorting out the laundry, finding sock pairs etc. Very cool sim, but kind of disappointed still. Will build this someday.

Haha, I wish - that would be great!

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#8

Post by jncfhnb » Sat, Jun 01, 2024, 8:50 PM UTC

lukko wrote: post #6

jncfhnb wrote: post #3

It seems weird that the interface seems to encourage interacting with it from afar and has no indicators as to where your actions would affect it (like a highly on a pickupable node). Is there some sort of intuitive reason for that that’s not obvious on a video? Not a complaint just curious.

Good point - I should have probably shown the direct interaction too (touching the actual fabric in space) - there's a gif here: https://jmp.sh/s/lHqJm6NEvqMqkXMPyUpZ . It was a little but laggy when also screen recording on device. In the video I am looking at where I want to interact and then using a pinch gesture and the sounds are mapped to different cells of the cloth. By either looking and tapping, or playing d…

So it looks for gesture events and maps them to locations where your eyes are looking rather than where the gesture was done?

Is that how most vision pro interfaces work?

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#9

Post by throwaway115 » Sat, Jun 01, 2024, 8:52 PM UTC

Congrats! What has it been like developing on the AVP?

Re: Show HN: I built an interactive cloth solver for Apple Vision Pro

#10

Post by lukko » Sat, Jun 01, 2024, 8:57 PM UTC

jncfhnb wrote: post #8

lukko wrote: post #6

Earlier quoted context omitted.

Good point - I should have probably shown the direct interaction too (touching the actual fabric in space) - there's a gif here: https://jmp.sh/s/lHqJm6NEvqMqkXMPyUpZ . It was a little but laggy when also screen recording on device. In the video I am looking at where I want to interact and then using a pinch gesture and the sounds are mapped to different cells of the cloth. By either looking and tapping, or playing d…

So it looks for gesture events and maps them to locations where your eyes are looking rather than where the gesture was done? Is that how most vision pro interfaces work?

Yes, that's basically it. If the gesture is targeted to something, either by looking at it or touching it directly in space then it responds. Direct touching takes priority, so I think you could look away but still touch in space.