Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini Robotics On-Device brings AI to local robotic devices

deepmind.google

Post reply on HN
Print view View original

21–30 of 92 posts

Re: Gemini Robotics On-Device brings AI to local robotic devices

#21

Post by marinmania »

baron816 wrote: post #18

I’m optimistic about humanoid robotics, but I’m curious about the reliability issue. Biological limbs and hands are quite miraculous when you consider that they are able to constantly interact with the world, which entails some natural wear and tear, but then constantly heal themselves.

It does either get very exciting or very spooky thinking of the possibilities in the near future.

I had always assumed that such a robot would be very specific (like a cleaning robot) but it does seem like by the time they are ready they will be very generalizable.

I know they would require quite a few sensors and motors, but compared to self-driving cars their liability would be less and they would use far less material.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#22

Post by didip »

baron816 wrote: post #18

I’m optimistic about humanoid robotics, but I’m curious about the reliability issue. Biological limbs and hands are quite miraculous when you consider that they are able to constantly interact with the world, which entails some natural wear and tear, but then constantly heal themselves.

I think those problems can be solved with further research in material science, no? Combined that with very responsive but low torque servos, I think this is a solvable problem.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#23

Post by moffkalast »

v9v wrote: post #13
ethan_smith wrote: post #11

Earlier quoted context omitted.

According to the blog post, it requires an NVIDIA Jetson Orin with at least 8GB RAM, and they've optimized for Jetson AGX Orin (64GB) and Orin NX (16GB) modules.

Could you quote where in the blog post they claim that? CTRL+F "Jetson" gave no results in TFA.

Yeah they didn't really mention anything, I was almost getting my hopes up that Google might be announcing a modernized Coral TPU for the transformer age, but I guess not. It's probably all just API calls to their TPUv6 data centers lmao.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#25

Post by pixl97 »

msgodel wrote: post #14
pixl97 wrote: post #12

Earlier quoted context omitted.

[Robot learns to superglue the switch open]

It's only going to do that if you RL it with episodes that include people shutting it down for safety. The RL I've done with my models are all simulations that don't even simulate the switch.

Which will likely work for only on machine AI, but it seems to me any very complicated actions/interactions with the world may require external interactions with LLMs which know these kind of actions. Or in the future the models will be far larger and more expansive on device containing this kind of knowledge.

For example, what if you need to train the model to keep unauthorized people from shutting it off?

Re: Gemini Robotics On-Device brings AI to local robotic devices

#26

Post by msgodel »

pixl97 wrote: post #25
msgodel wrote: post #14

Earlier quoted context omitted.

It's only going to do that if you RL it with episodes that include people shutting it down for safety. The RL I've done with my models are all simulations that don't even simulate the switch.

Which will likely work for only on machine AI, but it seems to me any very complicated actions/interactions with the world may require external interactions with LLMs which know these kind of actions. Or in the future the models will be far larger and more expansive on device containing this kind of knowledge. For example, what if you need to train the model to keep unauthorized people from shutting it off?

Having a robot near people with no master off switch sounds like a dumb idea.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#27

Post by generalizations »

martythemaniak wrote: post #17

I've spent the last few months looking into VLAs and I'm convinced that they're gonna be a big deal, ie they very well might be the "chatgpt moment for robotics" that everyone's been anticipating. Multimodal LLMs already have a ton of built-in understanding of images and text, so VLAs are just regular MMLLMs that are fine-tuned to output a specific sequence of instructions that can be fed to a robot. OpenVLA, which c…

I will be surprised if VLAs stick around, based on your description. That sounds far too low-level. Better hand that off to the 'nervous system' / kernel of the robot - it's not like humans explicitly think about the rotation of their hip & ankle when they walk. Sounds like a bad abstraction.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#28

Post by zzzeek »

THANK YOU.

Please make robots. LLMs should be put to work for *manual* tasks, not art/creative/intellectual tasks. The goal is to improve humanity. not put us to work putting screws inside of iphones

(five years later)

what do you mean you are using a robot for your drummer

Re: Gemini Robotics On-Device brings AI to local robotic devices

#29

Post by fragmede »

marinmania wrote: post #21
baron816 wrote: post #18

I’m optimistic about humanoid robotics, but I’m curious about the reliability issue. Biological limbs and hands are quite miraculous when you consider that they are able to constantly interact with the world, which entails some natural wear and tear, but then constantly heal themselves.

It does either get very exciting or very spooky thinking of the possibilities in the near future. I had always assumed that such a robot would be very specific (like a cleaning robot) but it does seem like by the time they are ready they will be very generalizable. I know they would require quite a few sensors and motors, but compared to self-driving cars their liability would be less and they would use far less mate…

The exciting part comes when two robots are able to do repairs on each other.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#30

Post by pryelluw »

fragmede wrote: post #29
marinmania wrote: post #21

Earlier quoted context omitted.

It does either get very exciting or very spooky thinking of the possibilities in the near future. I had always assumed that such a robot would be very specific (like a cleaning robot) but it does seem like by the time they are ready they will be very generalizable. I know they would require quite a few sensors and motors, but compared to self-driving cars their liability would be less and they would use far less mate…

The exciting part comes when two robots are able to do repairs on each other.

2 bots 1 bolt ?
Post reply on HN