Live data from Hacker News

Learning athletic humanoid tennis skills from imperfect human motion data

zzk273.github.io

31–40 of 44 posts

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#32
post #14

This is so interesting. Especially since it's kinda weird to train a robot to mimicking human play. I wonder what a perfect robot what actually behave like. It wouldn't need to split-step to activate muscles, the footwork would probably be minimal. I imagine a lot of different unusual looking swings to confuse human players, while still making perfect contact. It could make really late drop shots or even rotate the r…

The humans in the video shot easy balls to the robot, which returns more difficult balls. It's the human that is doing all the running. The robot is quite static. However with better software and better hardware is possible that the robot will be so fast that it will miss no ball, and so strong to return balls faster than any human can reach. So there is no need to play fine shots. That could be a goal if we want to provide automated training partners to humans. If we want to win games against humans, stronger and faster is more than enough.

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#33

Very impressive. But it doesn’t solve the whole problem yet. The robot and ball pose is estimated by high speed mocap cameras, and is fed to the policy. I imagine estimating that with onboard cameras - how humans do it - is much harder. Almost all of closed loop robotics is a state estimation problem. Control is “solved” if you can estimate state well enough.

We know. Just appreciate it for what it is. Which is…awesome.

I agree it is pretty awesome!

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#34
post #15

We have just started ramping up practical use of imitation learning from human demonstrations in humanoids. A bigger development is that one or two projects are working on training foundational vision action language models based on large video datasets. I think before the end of summer general purpose physical knowledge and capabilities will start to be demonstrated by one or more humanoid AI or robotics groups. May…

Hey guys I rooted my humanoid and it killed my mom when I disabled the "slow limb motion" mode. It just wacked her in the head as she walked in the kitchen and she's not moving what do I do??

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#35
post #32
post #14

This is so interesting. Especially since it's kinda weird to train a robot to mimicking human play. I wonder what a perfect robot what actually behave like. It wouldn't need to split-step to activate muscles, the footwork would probably be minimal. I imagine a lot of different unusual looking swings to confuse human players, while still making perfect contact. It could make really late drop shots or even rotate the r…

The humans in the video shot easy balls to the robot, which returns more difficult balls. It's the human that is doing all the running. The robot is quite static. However with better software and better hardware is possible that the robot will be so fast that it will miss no ball, and so strong to return balls faster than any human can reach. So there is no need to play fine shots. That could be a goal if we want to…

[dead]

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#36
post #15

We have just started ramping up practical use of imitation learning from human demonstrations in humanoids. A bigger development is that one or two projects are working on training foundational vision action language models based on large video datasets. I think before the end of summer general purpose physical knowledge and capabilities will start to be demonstrated by one or more humanoid AI or robotics groups. May…

>I'm guessing by next year or 2028 there will be services where you can order a robot to come cook and or clean for you.

Bullshit.

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#37
post #6

It is interesting to watch. The movements of the robot are robot-like. I mean, wtf, there were no robot playing tennis before, but I have an idea how a robot playing tennis would be like, and this video confirms my expectations. Sharp, unsure movements, a lot of hesitation, ... Movies pictured robots like this long before this become possible, but how did producers guessed it? Or maybe movies rendered different kinds…

Also, I can't help noticing that the guy(s) playing with the robot are doing their utmost to make it look good: playing the ball as gently as possible (so it has time to react and doesn't have to exert too much force to return it), aiming for places the robot can comfortably get to etc.

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#38
post #19

Earlier quoted context omitted.

That seems like quite an extrapolation and an extraordinary statement. This is a single task, in a lab setting. What your describing are extremely open-ended tasks in people’s homes. What is informing these timelines?

Look at recent developments/announcements involving novel increasingly generalizable learning capabilities from projects like 1X/Neo, Figure 03, Skild AI. Also see open published work like MimicDroid, HDMI, GenMimic, Humanoid-Union Dataset, RoboMirror, Being-H0 Figure 03: https://www.youtube.com/watch?v=e-31-KBBuXM https://www.youtube.com/watch?v=ZUTzuhkDG3w 1X Neo: https://www.youtube.com/watch?v=lS_z60kjVEk Skild A…

Yeah those are demos. I think we‘re pretty far away from this becoming a real thing. I wrote up why here: https://matthiasplappert.com/blog/2026/humanoid-robot-in-the...

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#39
post #34
post #15

We have just started ramping up practical use of imitation learning from human demonstrations in humanoids. A bigger development is that one or two projects are working on training foundational vision action language models based on large video datasets. I think before the end of summer general purpose physical knowledge and capabilities will start to be demonstrated by one or more humanoid AI or robotics groups. May…

Hey guys I rooted my humanoid and it killed my mom when I disabled the "slow limb motion" mode. It just wacked her in the head as she walked in the kitchen and she's not moving what do I do??

You should @linustechtips and hope he picks it up, then you have a good chance of getting a voucher for the funeral and getting a shout out in the manufacturers next demo when they talk about their new safety features.

Re: Learning athletic humanoid tennis skills from imperfect human motion data

#40

Very impressive. But it doesn’t solve the whole problem yet. The robot and ball pose is estimated by high speed mocap cameras, and is fed to the policy. I imagine estimating that with onboard cameras - how humans do it - is much harder. Almost all of closed loop robotics is a state estimation problem. Control is “solved” if you can estimate state well enough.

We know. Just appreciate it for what it is. Which is…awesome.

Look at the guys above posting that within 18 months these sorts of robots will be able to cook in anyone’s home; the above reminder is very necessary.
Post reply on HN