I tried the 2017 competition, and DDPG never converges for me. Since the 30+ dimensional state space is so large, I wonder are there some ML techniques that deal with dimensionality reduction or just large dimensions in general?
Reinforcement learning with musculoskeletal models
21–27 of 27 posts
Re: Reinforcement learning with musculoskeletal models
#22can this be used to help children with developmental delays and disabilities?
Re: Reinforcement learning with musculoskeletal models
#23Earlier quoted context omitted.
I've participated in the NIPS "Learning to run" competition last year. It only computes motion in one direction (forward-backward, the model can't go left or right). What turned me off was the fact that object collision was handled poorly. You can't see a model that actually makes effort to avoid obstacles, instead all top solutions go through objects.
That's only one-side of the story. It is actually a very accurate contact model. The problem is that it's also computationally expensive and therefore we reduce the stiffness of objects to make it faster. It's basically a trade-off between the accuracy and speed. In gaming engines you have speed and it looks good, but then it's impossible to generalize for real-life applications (because the contact is inaccurate).
> The problem is that it's also computationally expensive and therefore we reduce the stiffness of objects to make it faster.
Are y'all using penalty methods for the collisions? Which model does it use?
Re: Reinforcement learning with musculoskeletal models
#24A lot of these would be good submissions to the Ministry of Silly Walks
Re: Reinforcement learning with musculoskeletal models
#25Like literally 3 hours ago I was searching for software that can simulate skeletons and joints to investigate the exact effects of jiu jitsu joint locks, optimal fulcrum points etc. Could this be used or adapted for that? Anyone here ever used it?
I know a guy who is interested in that, take a look at this: https://github.com/Eelis/GrappleMap/blob/master/README.md
Re: Reinforcement learning with musculoskeletal models
#26Like literally 3 hours ago I was searching for software that can simulate skeletons and joints to investigate the exact effects of jiu jitsu joint locks, optimal fulcrum points etc. Could this be used or adapted for that? Anyone here ever used it?
I know a guy who is interested in that, take a look at this: https://github.com/Eelis/GrappleMap/blob/master/README.md
That's really cool, thanks for mentioning.
Re: Reinforcement learning with musculoskeletal models
#27Like literally 3 hours ago I was searching for software that can simulate skeletons and joints to investigate the exact effects of jiu jitsu joint locks, optimal fulcrum points etc. Could this be used or adapted for that? Anyone here ever used it?
Might find this interesting for extracting info from recorded bouts: https://github.com/CMU-Perceptual-Computing-Lab/openpose