Live data from Hacker News

Gemini Robotics-ER 1.6

deepmind.google

31–40 of 91 posts

Re: Gemini Robotics-ER 1.6

#31
post #21

A parcel of land. A few robot legs and arms, big battery, off-the-shelf GPU. Solar panels. Prompt: "Take care of all this land within its limits and grow some veggies."

What if it turns out that "take care of this land" means the traditional way California was taken care of with regular small slow burns. After over 10k years of this type of management there are many important native species that won't even germinate without the presence of ash.

Or it could turn out to look like satayoma (Japanese peasant forests) or it could be more similar to the crop rotation that was traditionally practiced in many parts of Central Africa where roots were important.

In Russia before the Soviets forced "modern scientific agriculture" on peasants to modernize, they practiced things like contour farming (where they interplanted rows of crops against the contours of the land to slow water down) and maslins (where they intermixed multiple varieties of wheat and barleys in the same patch). Now contour farming are an active area of research for their ability to prevent topsoil loss and build soil health while maslins provide superior yield stability and use little to no pesticides.

That's not even getting into the over 40-120,000 varieties of rice we've documented. Most of which are hyper adapted to a very specific location—often even a single village.

My point is there is no one way to take care of a plot of land. It's all relative to a number of factors beyond just the abiotic characteristics of the land itself. Your goals and intentions matter and you will always find localized unique adaptations.

Re: Gemini Robotics-ER 1.6

#32
post #27
post #21

A parcel of land. A few robot legs and arms, big battery, off-the-shelf GPU. Solar panels. Prompt: "Take care of all this land within its limits and grow some veggies."

Yeah I'm not sure how that's currently working out. https://proofofcorn.com/

Are you saying that has failed? It isn't obvious to me from that page that anything in particular is going wrong. I don't think anyone is daft enough to claim that AI solves the "Iowa remains unplantable due to winter conditions" problem.

Re: Gemini Robotics-ER 1.6

#33
Google and Boston Dynamics (of Spot, Atlas fame) formed a partnership a while back and they’ve been working on building models together.

Hyundai now owns Boston Dynamics and is pushing to get the robots into their factories.

Re: Gemini Robotics-ER 1.6

#34
post #21

A parcel of land. A few robot legs and arms, big battery, off-the-shelf GPU. Solar panels. Prompt: "Take care of all this land within its limits and grow some veggies."

Done! The whole planet is now veggies.

Re: Gemini Robotics-ER 1.6

#35

I’ve been thinking about AI robotics lately… if internally at labs they have a GPT-2, GPT-3 “equivalent” for robotics, you can’t really release that. If a robot unloading your dishwasher breaks one of your dishes once, this is a massive failure. So there might be awesome progress behind the scenes, just not ready for the general public.

> If a robot unloading your dishwasher breaks one of your dishes once, this is a massive failure.

Depending on what the rate of breaking dishes is, this would be a massive improvement on me, a human being, since I break a really important dish I needed to use like ~2x per month on average.

Re: Gemini Robotics-ER 1.6

#36
post #34
post #21

A parcel of land. A few robot legs and arms, big battery, off-the-shelf GPU. Solar panels. Prompt: "Take care of all this land within its limits and grow some veggies."

Done! The whole planet is now veggies.

It turned the planet into ‘taterchips!

Re: Gemini Robotics-ER 1.6

#37
post #32
post #27

Earlier quoted context omitted.

Yeah I'm not sure how that's currently working out. https://proofofcorn.com/

Are you saying that has failed? It isn't obvious to me from that page that anything in particular is going wrong. I don't think anyone is daft enough to claim that AI solves the "Iowa remains unplantable due to winter conditions" problem.

logs suggest it's been 'critically failing' and 'blocked for 68 days' on farmhand introduction, although the logs don't go back far enough (and cut off too early) to really tell what's going on. https://proofofcorn.com/log

Re: Gemini Robotics-ER 1.6

#38

Nice. I couldn't find the part that I'm most interested in though, latency. This beats their frontier vision model for some identification tasks -- for a robotics model, I'm interested in hz. Since this is an "Embodied Reasoning" model, I'm assuming it's fairly slow - it's designed to match with on-robot faster cycle models. Anyway, cool.

In my quick image recognition testing on AI studio, it's performance seems similar to 3.1 pro, but is much much faster. It "thinks" but only for a few seconds. Of course this is for counting animal legs while giving coordinates and reading analog clocks. Not coding or or solving puzzles. I imagine the image performance to model weight of this model is very high.

I thought the entire discourse on how important pointing is to be super interesting. I've been told, although I don't know if this is true, that dogs are the only animal that can understand human pointing. Fascinating to think this might be fundamental to world intelligence requirements. Well, it's required, but it's interesting to think that it might be a core structure required or that learning it might force some sort of neural architecture that's helpful.

And, I was disappointed to see that pointing was just giving x,y coords. I wanted to see robots pointing at stuff.

Re: Gemini Robotics-ER 1.6

#39
Would this approach destroy critical investments in physics- or modeling-based reasoning?

I'm all for the task reasoning and the multi-view recognition, based on relevant points. I'm very uncomfortable with the loose world "understanding".

The fault model I see is that e.g., this "visual understanding" will get things mostly right: enough to build and even deliver products. However, these are only probabilistic guarantees based on training sets, and those are unlikely to survive contact with a complex interactive world, particularly since robots are often repurposed as tasks change.

So it's a kind of moral-product-hazard: it delivers initial results but delays risk to later, so product developers will have incentives to build and leave users holding the bag. (Indeed: users are responsible for integration risks anyway.)

It hacks our assumptions: we think that you can take an MVP and productize it, but in this case, you'll never backfit the model to conform to the physics in a reliable way. I doubt there's any way to harness Gemini to depend on a physics model, so we'll end up with mostly-working sunk investments out in the market - slop robots so cheap that tight ones can't survive.

Re: Gemini Robotics-ER 1.6

#40
post #32
post #27

Earlier quoted context omitted.

Yeah I'm not sure how that's currently working out. https://proofofcorn.com/

Are you saying that has failed? It isn't obvious to me from that page that anything in particular is going wrong. I don't think anyone is daft enough to claim that AI solves the "Iowa remains unplantable due to winter conditions" problem.

Looking at the timeline they seem hopelessly behind. Its currently the planting window and they don't have land or a person to work it.
Post reply on HN