Our First Generalist Policy
physicalintelligence.company
Our First Generalist Policy
1–10 of 249 posts
Re: Our First Generalist Policy
#2At 1:50, the guy gives the robot a glass to pick up and then immediately nopes out of there. Wonder if previous demos resulted in a broken glass haha.
Also at 2:08 the upside-down container gets flipped quickly. I wonder if that was a known limitation of the robot at the time or if the person just had a desire to flip it right-side up (to be polite? haha).
I'm commenting on these tiny details and laughing a lot because I'm not sure I can handle a more serious approach to this. Doesn't it seem like in One last note, they call this generalist, but each of the examples is quite specific from a macro perspective. Yes the robot can fold maybe any pile of crumpled laundry now and that is generalist compared to previous efforts, but seems like we shouldn't be trying to train bots how to do billions of tasks in specific detail; rather they should learn to learn and take on new tasks they weren't trained for.
Re: Our First Generalist Policy
#3At 1:50, the guy gives the robot a glass to pick up and then immediately nopes out of there. Wonder if previous demos resulted in a broken glass haha. Also at 2:08 the upside-down container gets flipped quickly. I wonder if that was a known limitation of the robot at the time or if the person just had a desire to flip it right-side up (to be polite? haha). I'm commenting on these tiny details and laughing a lot becau…
> Doesn't it seem like in If you buy the hype, sure. I know many startups that have already gone bust working on this. I've also seen lots of similar attempts in laboratories around the world going back well over a decade.
> One last note, they call this generalist, but each of the examples is quite specific from a macro perspective. Yes the robot can fold maybe any pile of crumpled laundry now and that is generalist compared to previous efforts, but it does seem like we shouldn't try to train bots how to do billions of tasks in specific detail; rather they should learn to learn and take on new tasks they weren't trained for.
You are starting to see how difficult the problem is and how limited the solutions are. You're basically saying "let's just give the robots general AI and everything will be so much easier!"
Re: Our First Generalist Policy
#4This is a duplicate thread. Can some mod merge them oO? I don't know how this works on HN.
Re: Our First Generalist Policy
#5(I work at π.)
Happy to answer any questions on the model, hardware, etc
Re: Our First Generalist Policy
#6At 1:50, the guy gives the robot a glass to pick up and then immediately nopes out of there. Wonder if previous demos resulted in a broken glass haha. Also at 2:08 the upside-down container gets flipped quickly. I wonder if that was a known limitation of the robot at the time or if the person just had a desire to flip it right-side up (to be polite? haha). I'm commenting on these tiny details and laughing a lot becau…
> Doesn't it seem like in If you buy the hype, sure. I know many startups that have already gone bust working on this. I've also seen lots of similar attempts in laboratories around the world going back well over a decade. > One last note, they call this generalist, but each of the examples is quite specific from a macro perspective. Yes the robot can fold maybe any pile of crumpled laundry now and that is generalist…
Idk this is really promising, how many robot foundation models have you seen before that also work very well? I believe this is all quite recent.
Re: Our First Generalist Policy
#7(I work at π.) Happy to answer any questions on the model, hardware, etc
First of all - incredible work.
Do you guys plan to integrate frameworks like ROS to help manage this robot?
Re: Our First Generalist Policy
#8Earlier quoted context omitted.
> Doesn't it seem like in If you buy the hype, sure. I know many startups that have already gone bust working on this. I've also seen lots of similar attempts in laboratories around the world going back well over a decade. > One last note, they call this generalist, but each of the examples is quite specific from a macro perspective. Yes the robot can fold maybe any pile of crumpled laundry now and that is generalist…
Idk this is really promising, how many robot foundation models have you seen before that also work very well? I believe this is all quite recent.
I'm not saying there isn't progress. I'm saying progress is slow relative to the work that needs to be done. I've also worked at enough robotics companies to be skeptical of anything they publish because there is a strong tendency to cherry-pick results. The disconnect between the research papers being published and the reality of the robots at one company I worked at was pretty egregious.
Robots are super cool. Just be skeptical of the hype.
Re: Our First Generalist Policy
#9(I work at π.) Happy to answer any questions on the model, hardware, etc
I saw your foundation model is trained on data from several different robots. Is the plan to eventually train a foundation model that can control any robot zero shot? That is, the effect of actuations on video/sensor input is collected and understood in-context and actuations are corrected to yield intended behavior. All in-context. Is this feasible?
More specifically, has your model already exhibited this type of capability, in principle?
Re: Our First Generalist Policy
#10At 1:50, the guy gives the robot a glass to pick up and then immediately nopes out of there. Wonder if previous demos resulted in a broken glass haha. Also at 2:08 the upside-down container gets flipped quickly. I wonder if that was a known limitation of the robot at the time or if the person just had a desire to flip it right-side up (to be polite? haha). I'm commenting on these tiny details and laughing a lot becau…
I think it would be super awesome. I hate doing laundry so if someone sold a robot that washed + dry + folded all my laundry, I would spend money on it.
I'm talking about I want to throw my dirty clothes into a basket and it takes care of the rest.
The demo from the video gives me hope!