Live data from Hacker News

Gemini Robotics-ER 1.6

deepmind.google

61–70 of 91 posts

Re: Gemini Robotics-ER 1.6

#61

I’ve been thinking about AI robotics lately… if internally at labs they have a GPT-2, GPT-3 “equivalent” for robotics, you can’t really release that. If a robot unloading your dishwasher breaks one of your dishes once, this is a massive failure. So there might be awesome progress behind the scenes, just not ready for the general public.

There's not enough internet-scale data for robotics. The gap is huge! So anyone that claims to have a GPT like model is not behing honest.

Re: Gemini Robotics-ER 1.6

#62
Maybe dumb question: One of the use cases is instrument reading of analog instruments. My brain immediately goes to "this should have some sensor sending data, and not be analog". Is having a robot dog read analog sensors really a better fit in some cases?

Re: Gemini Robotics-ER 1.6

#63

Earlier quoted context omitted.

> If a robot unloading your dishwasher breaks one of your dishes once, this is a massive failure. Depending on what the rate of breaking dishes is, this would be a massive improvement on me, a human being, since I break a really important dish I needed to use like ~2x per month on average.

You really break a dish once every 2 weeks? That seems exceptionally clumsy. Not here to shame you for it, for the record.

> That seems exceptionally clumsy

That's me ;_;

Re: Gemini Robotics-ER 1.6

#64

Earlier quoted context omitted.

Really unfortunate that I forgot what YT video i saw about this just 2 weeks ago. It was about Googles PaLM-E evolution and progress. It basically has two models one which controls the robot, the other is a llm and they are combined together in some attention layer.

Must have been https://www.youtube.com/watch?v=2mrGMMmrVNE from Welch Labs.

That video is pretty good, thanks for finding it. I'm basically betting that an earlier, abandoned approach described in the video, "Code as Policy", will beat everything else. It requires no training data, and generalizes instantly to all robots.

Re: Gemini Robotics-ER 1.6

#65

Maybe dumb question: One of the use cases is instrument reading of analog instruments. My brain immediately goes to "this should have some sensor sending data, and not be analog". Is having a robot dog read analog sensors really a better fit in some cases?

It bears really thinking through the alternative:

So we're going to have some engineers specify suitable digital replacements given the process/environment/safety requirements. We'll procure those (noting that an industrial digital pressure transducer can easily push up towards $10k), schedule a plant shutdown (how much does that cost?), then pay a pipefitter/boilermaker to replace the old gauges with new pressure transmitters (do you need a hot work permit for that? Did you get your engineer to sign that off?). Then, your controls sparky has to find a way to route a drop back to your marshalling cabinet for connection into your fieldbus/HART/modbus/whatever network (do you have one of those?) so that your SCADA system can talk to it (do you have one of those?).

Obviously it's not really an apples-to-apples comparison, but I think the costs involved with making "simple" changes in industrial settings are easy to wildly underestimate.

Re: Gemini Robotics-ER 1.6

#66
post #21

A parcel of land. A few robot legs and arms, big battery, off-the-shelf GPU. Solar panels. Prompt: "Take care of all this land within its limits and grow some veggies."

Jury is still out as to how well it works, but the traditional prompt is: "Be fruitful, and multiply"

Re: Gemini Robotics-ER 1.6

#67
post #46
post #24

Earlier quoted context omitted.

Is emulating human behavior really a valuable end goal though? Humans exist as the evolutionary endpoint of exhaustion hunting large pray and organic tool-making. We've built loads of industrial and residential automation tools in the last 100 years and none of them are humanoid. I'd imagine a household robot butler would be more like R2D2 with lots and lots of arms.

It is when the world was made to interface with us. We can't use robots for everything if they aren't emulating us, because we would have to adapt everything for the non-humanlike robots.

We build our living spaces against the constraints of the human form, but that still doesn't imply the human form is optimal for anything. There's no reason a robot traveling over smooth surface should have legs instead of wheels or treads. There's no reason to have a head. Some kind of arm is a common design feature, but certainly no reason to have two. No reason to be symmetrical. A domestic robot may be constrained in terms of scale (ie see things at counter height) but not shape.

Re: Gemini Robotics-ER 1.6

#68

Maybe dumb question: One of the use cases is instrument reading of analog instruments. My brain immediately goes to "this should have some sensor sending data, and not be analog". Is having a robot dog read analog sensors really a better fit in some cases?

I can see many cases where installing an IoT camera will be more reliable and less costly than, "shut down equipment to unplug this analog instrument, hook up a digital one, calibrate it, then restart the equipment".

If it ain't broke don't fix it — pointing a cheap camera at it with some cloud compute will suffice.

Re: Gemini Robotics-ER 1.6

#70
post #67
post #46

Earlier quoted context omitted.

It is when the world was made to interface with us. We can't use robots for everything if they aren't emulating us, because we would have to adapt everything for the non-humanlike robots.

We build our living spaces against the constraints of the human form, but that still doesn't imply the human form is optimal for anything. There's no reason a robot traveling over smooth surface should have legs instead of wheels or treads. There's no reason to have a head. Some kind of arm is a common design feature, but certainly no reason to have two. No reason to be symmetrical. A domestic robot may be constraine…

Really, the requirements are for the robot to move in predictable ways (if something looks like an arm, it ought to move like an arm, etc), and to have enough strength to be useful for difficult/tiring tasks while somehow also not being dangerous if something does go wrong.
Post reply on HN