Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Gemini Robotics On-Device brings AI to local robotic devices

deepmind.google

Post reply on HN
Print view View original

31–40 of 92 posts

Re: Gemini Robotics On-Device brings AI to local robotic devices

#31

Post by Workaccount2 »

martythemaniak wrote: post #17

I've spent the last few months looking into VLAs and I'm convinced that they're gonna be a big deal, ie they very well might be the "chatgpt moment for robotics" that everyone's been anticipating. Multimodal LLMs already have a ton of built-in understanding of images and text, so VLAs are just regular MMLLMs that are fine-tuned to output a specific sequence of instructions that can be fed to a robot. OpenVLA, which c…

I don't think transformers will be viable for self driving cars until they can both:

1) Properly recognize what they are seeing without having to lean so hard on their training data. Go photoshop a picture of a cat and give it a 5th leg coming out of it's stomach. No LLM will be able to properly count the cat's legs (they will keep saying 4 legs no matter how many times you insist they recount).

2.) Be extremely fast at outputting tokens. I don't know where the threshold is, but its probably going to be a non-thinking model (at first) and probably need something like Cerebras or diffusion architecture to get there.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#32

Post by Workaccount2 »

I continued to be impressed how Google stealth releases fairly groundbreaking products, and then (usually) just kind of forgets about them.

Rather than advertising blitz and flashy press events, they just do blog posts that tech heads circulate, forget about, and then wonder 3-4 years later "whatever happened to that?"

This looks awesome. I look forward to someone else building a start-up on this and turning it into a great product.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#33

Post by marinmania »

fragmede wrote: post #29
marinmania wrote: post #21

Earlier quoted context omitted.

It does either get very exciting or very spooky thinking of the possibilities in the near future. I had always assumed that such a robot would be very specific (like a cleaning robot) but it does seem like by the time they are ready they will be very generalizable. I know they would require quite a few sensors and motors, but compared to self-driving cars their liability would be less and they would use far less mate…

The exciting part comes when two robots are able to do repairs on each other.

I think this is the spooky part. I feel dumb saying it, but is there a point where they are able to coordinate and build a factory to build chips/more of themselves? Or other things entirely?

Re: Gemini Robotics On-Device brings AI to local robotic devices

#34

Post by UltraSane »

baron816 wrote: post #18

I’m optimistic about humanoid robotics, but I’m curious about the reliability issue. Biological limbs and hands are quite miraculous when you consider that they are able to constantly interact with the world, which entails some natural wear and tear, but then constantly heal themselves.

Consumable components could be automatically replaced by other robots.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#35

Post by jagger27 »

These are going to be war machines, make absolutely no mistake about it. On-device autonomy is the perfect foil to escape centralized authority and accountability. There’s no human behind the drone to charge for war crimes. It’s what they’ve always dreamed of.

Who’s going to stop them? Who’s going to say no? The military contracts are too big to say no to, and they might not have a choice.

The elimination of toil will mean the elimination of humans all together. That’s where we’re headed. There will be no profitable life left for you, and you will be liquidated by “AI-Powered Automation for Every Decision”[0]. Every. Decision. It’s so transparent. The optimists in this thread are baffling.

0: https://www.palantir.com/

Re: Gemini Robotics On-Device brings AI to local robotic devices

#36

Post by mateus1 »

jagger27 wrote: post #35

These are going to be war machines, make absolutely no mistake about it. On-device autonomy is the perfect foil to escape centralized authority and accountability. There’s no human behind the drone to charge for war crimes. It’s what they’ve always dreamed of. Who’s going to stop them? Who’s going to say no? The military contracts are too big to say no to, and they might not have a choice. The elimination of toil wil…

MIT spinoff Google-owned Boston Dynamics pledged not to militarize their robots. Which is very hard to believe given they're backed by DARPA, the DoD/Military investment arm.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#37

Post by jagger27 »

mateus1 wrote: post #36
jagger27 wrote: post #35

These are going to be war machines, make absolutely no mistake about it. On-device autonomy is the perfect foil to escape centralized authority and accountability. There’s no human behind the drone to charge for war crimes. It’s what they’ve always dreamed of. Who’s going to stop them? Who’s going to say no? The military contracts are too big to say no to, and they might not have a choice. The elimination of toil wil…

MIT spinoff Google-owned Boston Dynamics pledged not to militarize their robots. Which is very hard to believe given they're backed by DARPA, the DoD/Military investment arm.

Militarize is just bad marketing. Call them cleaning machines and put them to work on dirty things.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#38

Post by paxys »

mateus1 wrote: post #36
jagger27 wrote: post #35

These are going to be war machines, make absolutely no mistake about it. On-device autonomy is the perfect foil to escape centralized authority and accountability. There’s no human behind the drone to charge for war crimes. It’s what they’ve always dreamed of. Who’s going to stop them? Who’s going to say no? The military contracts are too big to say no to, and they might not have a choice. The elimination of toil wil…

MIT spinoff Google-owned Boston Dynamics pledged not to militarize their robots. Which is very hard to believe given they're backed by DARPA, the DoD/Military investment arm.

Was owned by Google. Then Softbank. Now Hyundai.

Re: Gemini Robotics On-Device brings AI to local robotic devices

#39

Post by martythemaniak »

Workaccount2 wrote: post #31
martythemaniak wrote: post #17

I've spent the last few months looking into VLAs and I'm convinced that they're gonna be a big deal, ie they very well might be the "chatgpt moment for robotics" that everyone's been anticipating. Multimodal LLMs already have a ton of built-in understanding of images and text, so VLAs are just regular MMLLMs that are fine-tuned to output a specific sequence of instructions that can be fed to a robot. OpenVLA, which c…

I don't think transformers will be viable for self driving cars until they can both: 1) Properly recognize what they are seeing without having to lean so hard on their training data. Go photoshop a picture of a cat and give it a 5th leg coming out of it's stomach. No LLM will be able to properly count the cat's legs (they will keep saying 4 legs no matter how many times you insist they recount). 2.) Be extremely fast…

1. Well, based on Karpathy's talks on Tesla FSD, his solution is to actually make the training set reflect everything you'd see in reality. The tricky part is that if something occurs 0.0000001% IRL and something else occurs 50% of the time, they both need to make 5% of the training corpus. The thing with multimodal LLMs is that lidar/depth input can just be another input that gets encoded along with everything else, so for driving "there's a blob I don't quite recognize" is still a blob you have to drive around.

2. Figure has a dual-model architecture which makes a lot of sense: A 7B model that does higher-level planning and control and a runs at 8Hz, and a tiny 0.08B model that runs at 200Hz and does the minute control outputs. https://www.figure.ai/news/helix

Re: Gemini Robotics On-Device brings AI to local robotic devices

#40

Post by JumpCrisscross »

jagger27 wrote: post #35

These are going to be war machines, make absolutely no mistake about it. On-device autonomy is the perfect foil to escape centralized authority and accountability. There’s no human behind the drone to charge for war crimes. It’s what they’ve always dreamed of. Who’s going to stop them? Who’s going to say no? The military contracts are too big to say no to, and they might not have a choice. The elimination of toil wil…

> These are going to be war machines, make absolutely no mistake about it

Of course they will. Practically everything useful has a military application. I'm not sure why this is considered a hot take.

Post reply on HN