111–120 of 149 posts
I feel like I’m the right audience for this - a not very good climber with unusual distribution of limbs. But I’m not interested - part of the fun in climbing is on sight climbs and solving problems yourself.
Edit: Unsurprised to see the demo on a gym route instead of actual rock.
I feel like I’m the right audience for this - a not very good climber with unusual distribution of limbs. But I’m not interested - part of the fun in climbing is on sight climbs and solving problems yourself.
Came here hoping to see something like this. Glad to see it’s the top comment. Part of the beauty of climbing is solving a puzzle and figuring things out. Edit: Unsurprised to see the demo on a gym route instead of actual rock.
Note: Will attach more example outputs and make a detailed document about how the model was built and the research behind it. If this is interesting to you, feel free to sign up to the waitlist on www.climbing.ai (and make sure to sign up for our Discord!) I originally planned on open sourcing the model, data, weights, and code. Only a few people (me and a couple friends) have access to the hosted model on the web ap…
*temper expectations!
A few thoughts as I've done academic research & built products in this area: - if you're using SMPL body parameters this will have to stay research / open-source - is this leveraging some sort of monocular depth estimation to estimate the wall in 3D space? Also, do you have assumed camera parameters, or is that also estimated? If there isn't any depth information, this will be highly inaccurate on any cliff routes, b…
This is an end-end system that just takes in video frames. Camera parameters are one of the things that is predicted. It gives promising results for a wide variety of environments (cliffs, diff types of bouldering walls, diff outdoor walls, etc.), though not always accurate. Path planning is also part of the end-end system. Will share more details in the paper.
It looks really interesting, but as an experienced climber I'm not sure if just watching a video of my avatar climbing would really help with skill acquisition. Also, this claims that the wall type or video quality doesn't matter, but I have a hard time understanding how the model would be able to understand that a small crimp could possibly be dual textured and therefore has only a few specific ways of approaching i…
Of the full distribution of possible video qualities one can take on a modern phone camera, the vast majority of video qualities will be fine for the AI to understand fine details. Obviously, if you somehow or for some reason, take a video with really bad quality, it will not give you what you want.
Same explanation goes for the walls. If you take a video of just a really dark wall with really bad holds, it is probably won't give you what you want either.
It looks really interesting, but as an experienced climber I'm not sure if just watching a video of my avatar climbing would really help with skill acquisition. Also, this claims that the wall type or video quality doesn't matter, but I have a hard time understanding how the model would be able to understand that a small crimp could possibly be dual textured and therefore has only a few specific ways of approaching i…
I suspect that, absent that information about the exact right way to grab a hold, or the exact way to put a foot on a hold, you'll be limited to beta suggestions , which is fine, I think. It'd be like having a group of other climbers nearby to suggest different beta, even if you don't have any friends. So, in terms of solving complicated beta faster, I see real utility to this. It is very interesting that since the A…
But really though, awesome project and congrats on getting it to this point! I'm excited for the day when something like this can be used to critique form
I feel like I’m the right audience for this - a not very good climber with unusual distribution of limbs. But I’m not interested - part of the fun in climbing is on sight climbs and solving problems yourself.
If you never feel like you need help from watching someone else climb, then I think you are not trying hard enough problems.
Maybe also good thing for the next Mission Impossible movie if they ever make one.