Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini Robotics 2 brings whole body intelligence to robots

deepmind.google

Post reply on HN
Print view View original

151–160 of 583 posts

Re: Gemini Robotics 2 brings whole body intelligence to robots

#151

Post by jaccola »

qurren wrote: post #40
pwython wrote: post #16

Earlier quoted context omitted.

For house keeping tasks the robotics companies love showing off... it honestly doesn't matter if it takes a robot longer than a human to clean your house. As long as it gets done before you get home from work, no big deal.

I'm bearish that they'll be economically viable in the house for a very long time. For businesses the bar for adoption is very low: If the thing can work repetitive jobs for 24 hours a day and replace 3 shifts, the purchase bar is nominally anything less than 3 x human salary if your budgeting horizon is 1 year. That's a high number, and probably fairly easy to achieve. For homes, it's a very different bar. You'd hav…

Another huge blocker (that is essentially just cost too) is maintenance. These things are like 1000x more complex than a car, need to work in a diverse range of environments, handle water, household chemicals, different humidities, kids, etc… maybe eventually robots will service robots but that seems very hard!

And talking of kids, these will have to be exceedingly safe, a 6ft machine falling on a child is probably a worry most households could do without.

Re: Gemini Robotics 2 brings whole body intelligence to robots

#152

Post by YuechenLi »

Running a full LLM to actuate a robot is way too heavy, the minimum latency they can get down to is probably 1-2 seconds even with powerful GPUs, which is not very useful for practical robotics applications.

Machine vision should definitely be handled by ML, but motion actuation should be relegated in the realm of traditional PID style linear/nonlinear control. Again, the tech is cool, but the practical usefulness of using a full LLM as a controller will probably run into hardware limitations.

Re: Gemini Robotics 2 brings whole body intelligence to robots

#153

Post by claaams »

moffkalast wrote: post #141
pwython wrote: post #16

Earlier quoted context omitted.

For house keeping tasks the robotics companies love showing off... it honestly doesn't matter if it takes a robot longer than a human to clean your house. As long as it gets done before you get home from work, no big deal.

"That's fair, you are absolutely right I should not have unscrewed the water hose and put it away before turning on the valve to water the plants, even though you specified that order, I should've used some common sense." There is going to be so much pain from VLA malicious compliance. If the current gen of LLMs are anything to go by I can already see it being an hilariously massive problem. People are careless.

This was my thought too. An unsupervised robot can cause 10s of thousands in damage by accidentally ripping a water line and flooding your house or just breaking all of your dishes. There’s no level to how dumb and awful LLMs can hallucinate

Re: Gemini Robotics 2 brings whole body intelligence to robots

#155

Post by pertymcpert »

soperj wrote: post #101
neutronicus wrote: post #65

Earlier quoted context omitted.

I mean, a twice-monthly house-cleaning service is running you ballpark 5k/year and people treat that shit as non-negotiable. I tried to claw back that line item after our second baby was born (wife didn't want them in the house anyway when we had a newborn), and it was completely unsuccessful. She claimed misery and all our friends were on her side. So the lifestyle stayed inflated.

> ballpark 5k/year How big is your house? When we had a cleaning lady it was $70 a go. Under $2000 for every second week.

I have a 1300 sqft house, 3b2b. Costs me around $200 for a cleaning.

Re: Gemini Robotics 2 brings whole body intelligence to robots

#156

Post by fidotron »

RandomLensman wrote: post #36
FartyMcFarter wrote: post #30

Earlier quoted context omitted.

> Hell, the only ones that can afford them will be the same that would hire human household help. But maybe they'd rather deal with a robot than a human?

Honestly: why?

Humans have emotions. Best avoided.

Re: Gemini Robotics 2 brings whole body intelligence to robots

#157

Post by CardenB »

YuechenLi wrote: post #152

Running a full LLM to actuate a robot is way too heavy, the minimum latency they can get down to is probably 1-2 seconds even with powerful GPUs, which is not very useful for practical robotics applications. Machine vision should definitely be handled by ML, but motion actuation should be relegated in the realm of traditional PID style linear/nonlinear control. Again, the tech is cool, but the practical usefulness of…

AFAIK NVidia has a VLA running on their chips with 2B params at 10Hz. They’ve openly published a .5B model running at 10Hz

Re: Gemini Robotics 2 brings whole body intelligence to robots

#158

Post by pertymcpert »

RandomLensman wrote: post #85
seasox wrote: post #54

Earlier quoted context omitted.

Robots don‘t steal and don‘t want a raise.

If there is a subscription in there somewhere, prices could change.

It's ok, we get it you don't want one. I would happily pay $20k-$30k for one if it worked well. I know a lot of people who would.

Re: Gemini Robotics 2 brings whole body intelligence to robots

#159

Post by fc417fc802 »

hwillis wrote: post #77
FartyMcFarter wrote: post #12

These robots look slow and not very fluid in their motions, but LLMs like ChatGPT also looked very dumb initially. If progress is as fast as LLMs , this could have massive applications in a few years.

The time between gpt 2 and 3 was 15 months. The time between gemini robotics 1 and 2 was also 15 months: https://blog.google/products-and-platforms/products/gemini/h... The difference between gpt 2 and 3 was insane. 2 could generate limericks when it wasn't repeating a word 300x. 3 could actually do some things. By comparison gemini robotics has hardly changed at all. I will also point out that slow, non-fluid roboti…

> folding them quickly, so that the fabric is actually moving instead of just hanging still- incredibly, incredibly more complex.

TBF fabric is much more difficult to simulate than a bipedal body is.

As I recall openai had mujoco playing soccer nearly 10 years ago. Obviously real world bodies are much more difficult but I'd be curious to learn why that is.

Re: Gemini Robotics 2 brings whole body intelligence to robots

#160

Post by tamimio »

aabhay wrote: post #4

Can anyone that works on this technology provide an honest assessment of where this technology actually stands? How much instrumentation is actually required, what the interaction quality is, how much trouble do humanoids have with in the wild daily tasks like turning doorknobs, recovering from falls, avoiding knocking into things, etc.

There is a LOT of monkey business when it comes to robotics industry, a lot of demos you see are well crafted for that specific demo, a lot of times there’s even actual fraud “like claiming it’s an autonomous but it was actually teleoperated during the demo”, a lot robots that make most hypes are practically useless (dog robots or qugv for example) no matter how they try to create a usecase, when it comes to practicality, most fail. Robotics as an industry is niche (not to be confused with cobotics) the only exception is drones which is something I said in a workshop back in 2020 that drones are the only potential and will dominate if we solved the endurance issue, which is also why they immediately got weaponized because humans are usually evil and will utilize useful stuff in bad things.

Humanoids are far from being remotely useful in real life scenarios, yet.

Fun fact: most (if not all) qugv can’t go reverse on a stairway.

Post reply on HN