All VLM, VLA models.
I wonder if these architectures will reach prod before Yann LeCunn's world model JEPA startup even gets off the ground in Europe.
Gemini Robotics 2 brings whole body intelligence to robots
11–20 of 584 posts
Re: Gemini Robotics 2 brings whole body intelligence to robots
#12These robots look slow and not very fluid in their motions, but LLMs like ChatGPT also looked very dumb initially. If progress is as fast as LLMs , this could have massive applications in a few years.
Re: Gemini Robotics 2 brings whole body intelligence to robots
#13> It can better detect when humans are nearby, trigger safety tool calls and bring the robot to a safe stop if someone approaches too closely. If the robots stop when humans are too close, wouldn't that mean that robots for close interaction or handling of humans need a whole other level of control?
Also, "better" is doing a lot of lifting here, meaning it still fails regularly.
Re: Gemini Robotics 2 brings whole body intelligence to robots
#14All VLM, VLA models. I wonder if these architectures will reach prod before Yann LeCunn's world model JEPA startup even gets off the ground in Europe.
A 36% success rate on screwing in a light bulb means there's probably something to LeCunn's take that VLM/VLA models aren't going to be the thing powering tomorrow's robots, but only time will tell.
Re: Gemini Robotics 2 brings whole body intelligence to robots
#15It's funny how Google is essentially trying to compete with the software side of Tesla only - Waymos (which AFAIK they plan to partner with major automakers), now this, etc.
Seems smart. There are dozens of companies that make low-margin cars. There's only one company that has managed to make a working autonomous software driver.
Re: Gemini Robotics 2 brings whole body intelligence to robots
#16These robots look slow and not very fluid in their motions, but LLMs like ChatGPT also looked very dumb initially. If progress is as fast as LLMs , this could have massive applications in a few years.
For house keeping tasks the robotics companies love showing off... it honestly doesn't matter if it takes a robot longer than a human to clean your house. As long as it gets done before you get home from work, no big deal.
Re: Gemini Robotics 2 brings whole body intelligence to robots
#17It's funny how Google is essentially trying to compete with the software side of Tesla only - Waymos (which AFAIK they plan to partner with major automakers), now this, etc.
Another way to look at it is that they're avoiding some of the expensive parts of making products that use AI, while leaning into their strengths. No Tesla required within the explanation.
Re: Gemini Robotics 2 brings whole body intelligence to robots
#18[dead]
Re: Gemini Robotics 2 brings whole body intelligence to robots
#19Wow, what a time to be alive!
I would caution against enthusiasm. Anyone opposing those who end up controlling these robots won't be alive for long.
Re: Gemini Robotics 2 brings whole body intelligence to robots
#20Can anyone that works on this technology provide an honest assessment of where this technology actually stands? How much instrumentation is actually required, what the interaction quality is, how much trouble do humanoids have with in the wild daily tasks like turning doorknobs, recovering from falls, avoiding knocking into things, etc.
IMHO the real test is if any robotic startup currently selling (or planning to sell) robots as a service for homes not just use it but gets returning users from it.
I did professionally few prototypes with robots and progress is real yet very far from what the average customer would find reliably useful in menial tasks.
FWIW I do think https://rodneybrooks.com/why-todays-humanoids-wont-learn-dex... remains relevant, namely dexterity is also a hardware problem, grippers aren't hands. They even clarify "multi-finger dexterous manipulation remains challenging." and those aren't even fingers with a lot of sensors.