Human Motion Diffusion Model

I wonder if you could just simulate a skeleton and realistic maximum torque values for the joints and factor in mass and center of mass for each segment. Obviously that doesn't get you "how" to move each limb, but it at least could work to train a network GAN style so that the motion looks realistic. I feel like movements that are physically impossible are some of the most significant things that break immersion and that's something you can model with a physics engine to set some boundaries on training a model based off motion capture training data.