Live data from Hacker News

Gemini Robotics

deepmind.google

241–250 of 588 posts

Re: Gemini Robotics

#241

Robotics has been trying the same ideas for the last who knows how many years. They still believe it will work now, somehow. Perhaps it goes beyond the brightest minds at Google that people can grasp things with their eyes closed. That we don't need to see to grasp. But designing good robots with tactile sensors is too much for our top researchers.

I'm a bit confused. Ex-Googler so maybe I'm just spoiled by access to non-public information? But I'm fairly sure there's plenty of public material of Google robots gripping. Is it a play on words? Like, "we don't need to see to grasp", but obviously that isn't what you meant. We just don't need to if we saw it previously, and it hadn't moved. EDIT: It does look like the video demonstrates this, including why you can…

I think the point GP is raising is that most of the robotic development in the past several decades has been on Motion Control and Perception through Visual Servoing.

Those are realistically the 'natural' developments in the domain knowledge of Robotics/Computer Science.

However, what GP (I think) is raising is the blind spot that robotics currently has on proprioception and tactile sensing at the end-effector as well as a along the kinematic chain.

As in you can accomplish this with just kinematic position and force feedback and Visual servoing. But if you think of any dexterous primate they will handle an object and perceive texture, compliance, brittleness etc in a much richer way then any state-of-the art robotic end-effector.

Unless you devote significant research to creating miniaturized sensors that give a robot an approximation of the information rich sources in human skin, connective tissue, muscle, joints (tactil sensors, tensile sensor, vibration sensors, Force sensors) that blind spot remains.

Re: Gemini Robotics

#242

I read too much scifi, and almost none of it has updated on the current state of AI. For example spaceships swarming with low skill level crew members that swab the decks and replace air filters. Or depending on a single engineer to be the only one with the crucial knowledge to save the ship in an emergency. If scifi authors aren't keeping up it's hard to expect the rest of us to. But the macro and micro economic cha…

> Or depending on a single engineer to be the only one with the crucial knowledge to save the ship in an emergency.

This seems like it's rooted in reality.

Re: Gemini Robotics

#243
post #239

I'm a firmware engineer that's been working in consumer electronics and I feel very bleak about my future I feel so left behind. I have extremely limited robotics and computer vision experience. I have no ML experience. The only math I know has to do with basic signal processing. When I see open roles at these companies I think the projects I'm going to work on in the future will be more and more irrelevant to societ…

For what it's worth, I really appreciate your post.

Re: Gemini Robotics

#244
post #26
post #2

I am not sure whether the videos are representative of real life performance or it is a marketing stunt but sure looks impressive. Reminds of the robot arm in Iron Man 1.

AI demos and even live presentations have exacerbated my trust issues. The tech has great uses but there is no modesty from the proprieters.

Google in particular has had some egregiously fake AI demos in the past.

Re: Gemini Robotics

#245
post #177

One of my previous coworkers put it best: the cool looking proof of concept or prototype is 10% of the effort, and getting something that works in the real world and that people actually want is the other 100%. If we see a real world application that a business actually uses, or that people want to use, that's great. But why announce the prototype with the lab demos? It's premature. Better to wait until you have a go…

> But why announce the prototype with the lab demo

Because that's how you attract the media attention, talent, and financing you need to both go from prototype for product, and to have a market ready for the product when its ready.

Especially when other people are already publicly known to be working in the domain.

Re: Gemini Robotics

#246
post #239

I'm a firmware engineer that's been working in consumer electronics and I feel very bleak about my future I feel so left behind. I have extremely limited robotics and computer vision experience. I have no ML experience. The only math I know has to do with basic signal processing. When I see open roles at these companies I think the projects I'm going to work on in the future will be more and more irrelevant to societ…

Even for AI engineers, the future is not necessarily bright. These approaches are so powerful and so general that the world is probably not going to need that many of them.

I think where the real work will be is taking these models and creating real products out of them.

Re: Gemini Robotics

#248

Earlier quoted context omitted.

"locate the filters, locate the coffee mugs, locate a measuring spoon" in a random house in America is a very high standard. We’ll have to agree to disagree on that. If you teleport me into a random house, I’ll likely spend at least an hour trying and failing at that task, and most of their cabinets and drawers will be open by the end of it. It also excludes corner cases like "what if they don’t have any filters"? Sh…

and what if there's only a Nespresso machine, a Keurig machine, instant, a french press, a moka pot, or a cappuccino machine (we can argue if an americano is actually coffee, but if that's what the house has, and no drip machine + accoutrements, you're not getting anything else)? Human or bot, that's a lot of possibilities to deal with, but for a bold human unfamiliar with those, they're just a YouTube video away (mu…

It probably shouldn't continue to surprise me how often people's "AI benchmarks" exclude a significant fraction of actual, living, humans from being "human-grade".

Re: Gemini Robotics

#249
post #82

Earlier quoted context omitted.

On one hand, I agree with you, on the other, as a former Googler I think that "just needs better coaching" is a huge barrier in Google's current corporate culture and environment. Google as a whole has a long history of not being able to successfully build great products out of great tech. That seems wrong from looking at search, Gmail, Maps*, Docs*, etc., but I think these are cases where a single great insight or i…

Only disagree with the last part of your footnote. YouTube was acquired with an underpants gnomes' business model: spend $$$$ on network traffic; ????; profit! The "key advantage" that enabled YouTube was dirt-cheap global networking. And I think that is the thread that ties together all of Google's products. They are the protobuf moving company, first and foremost. Even on AI one of their key advantages is the abili…

This is a bad take. The business model is pretty clear: subsidized new line of business using the search revenu until it is so dominant that no competition is viable, only then heavily monetize it.

Re: Gemini Robotics

#250

The problem with Google is that their ad business brings so much revenue that no other product makes sense. They will use whatever they learn with robots to raise their ad revenue, somehow.

Google uses their insane ad revenue to subsidize the Xerox Parc / Bell Labs of the current generation. Waymo, DeepMind, Gemini Robotics. They're killing it and leading the entire market.

It's not just researchers. Engineers at Google get to spin up products and throw spaghetti at walls, too. Google has more money than God to throw around.

Google's ad dominance will probably never go away unless antitrust action by the FTC/DOJ/EU force a breakup. So they'll continue to lead as long as they can subsidize and outspend everyone else. Their investments compound and give an almost unassailable moat into deep tech problems.

Google might win AI and robotics and transportation and media and search 2.0. They'll own everything.

Post reply on HN