Live data from Hacker News

Gemini Robotics

deepmind.google

311–320 of 588 posts

Re: Gemini Robotics

#311

If this makes it easier and faster to sort garbage, we could probably improve the efficiency of recycling 100x. I know there are some places that do that already, but there are so many menial tasks that could be done by robots to improve the world.

Nobody cares about the efficiency of recycling. Existing pro-recycling orgs will want no part of this and do what they can to stop it. This is because if it becomes easy then it won’t matter and all the marketing, non profit orgs and everything goes away, making it a non problem. While I am sure you will find people who will like these ideas and want them, they will have zero control. At this point recycling is a mar…

Most folks when they think of recycling, think of the blue bin they put out every week.

That’s about 25% by weight of all that gets recycled in the country.

Metals, industrial scrap, and other sources are 75% of what gets recycled in the US.

We are blue collar businesses, with high labor costs. Many are exploring robotics actively for repetitive tasks. We have some robots in our process, looking for more when the ROI makes sense.

It may not be 100x, but there will be value in robots in recycling.

Re: Gemini Robotics

#312

If this makes it easier and faster to sort garbage, we could probably improve the efficiency of recycling 100x. I know there are some places that do that already, but there are so many menial tasks that could be done by robots to improve the world.

Nobody cares about the efficiency of recycling. Existing pro-recycling orgs will want no part of this and do what they can to stop it. This is because if it becomes easy then it won’t matter and all the marketing, non profit orgs and everything goes away, making it a non problem. While I am sure you will find people who will like these ideas and want them, they will have zero control. At this point recycling is a mar…

Well, it's actually good to have that kind of marketing. First, because there are people that don't care anyway and keep mixing things. So, robots can be useful just the same. And for the ones that actually follow the marketing, it's a good incentive to try to reduce the usage of one use plastics and packages in general. Recycling is the last of the 3 Rs for a reason.

Re: Gemini Robotics

#313
post #239

I'm a firmware engineer that's been working in consumer electronics and I feel very bleak about my future I feel so left behind. I have extremely limited robotics and computer vision experience. I have no ML experience. The only math I know has to do with basic signal processing. When I see open roles at these companies I think the projects I'm going to work on in the future will be more and more irrelevant to societ…

Get concerned when you see a real product in the market that has a sustainable business model. The man behind the curtain here has an army of engineers, unlimited cloud nodes and basically has harvested all the data currently available in the world. It doesn't get any better than this right now. What's next? They'll ping you later on Linked-in with this awesome idea that you need to make sure runs in a $1 USD microco…

I saw Musk saying a couple of days ago that we've "hit the limit of peak data" for training AI. My immediate reaction was no, surely you have not trained on every copyrighted textbook on every subject ever written. You hit the peak of easily accessible internet data that you could quickly steal to train your models.

Re: Gemini Robotics

#314
Gathering the necessary training data for embodied models is going to be a real doozy. Hard to scale, unless you figure out how to make a perfect simulator or possibly collect data in a decentralized manner...?

Re: Gemini Robotics

#315

If this makes it easier and faster to sort garbage, we could probably improve the efficiency of recycling 100x. I know there are some places that do that already, but there are so many menial tasks that could be done by robots to improve the world.

Nobody cares about the efficiency of recycling. Existing pro-recycling orgs will want no part of this and do what they can to stop it. This is because if it becomes easy then it won’t matter and all the marketing, non profit orgs and everything goes away, making it a non problem. While I am sure you will find people who will like these ideas and want them, they will have zero control. At this point recycling is a mar…

just pet bottle recycling by itself is a multi-billion dollar industry globally [1]

[1](https://en.wikipedia.org/wiki/PET_bottle_recycling)

Re: Gemini Robotics

#316

If this makes it easier and faster to sort garbage, we could probably improve the efficiency of recycling 100x. I know there are some places that do that already, but there are so many menial tasks that could be done by robots to improve the world.

Folks in the industry are certainly thinking about this. The economic forces at play could be huge.

Re: Gemini Robotics

#317

So has the labels like "Autonomous 1x" actually been a thing that Google has used before, or is it actually meant to be an "inside joke" jab at Tesla's previous videos that had small labels indicating the video was sped up and/or being human controlled?

Parts of the video are sped up. These are labeled "Autonomous 5x", etc. In some cases, it's not obvious, so it's useful to have the label.

And many popular robotics demos are either controlled by humans or scripted, so it's useful to have the "Autonomous" label as well to clear up confusion. For example, I know a lot of people who thought the recent Unitree G1 demos were autonomous.

Re: Gemini Robotics

#318

Gathering the necessary training data for embodied models is going to be a real doozy. Hard to scale, unless you figure out how to make a perfect simulator or possibly collect data in a decentralized manner...?

I immediately am reminded of stuff like https://oasis-model.github.io/, simply because I think you could probably:

1) tweak something like that to increase the likelihood of certain situations (abundance of a particular resource/object; frequent geographical feature), and

2) instruct your embodied AI to control a "player" model (to whatever degree of accuracy in articulation/mobility) to wander and perform certain types of tasks.

Re: Gemini Robotics

#319

question for the robot experts: what is the limitation that makes the movements so slow? for example when it picks up the ball and puts it in the basket. why couldn't that movement be done much faster?

inference speed of the models is probably the bottleneck

Re: Gemini Robotics

#320

question for the robot experts: what is the limitation that makes the movements so slow? for example when it picks up the ball and puts it in the basket. why couldn't that movement be done much faster?

In this case it’s the model. There’s an insane amount of computation that should happen in milliseconds but given today’s hardware might run 10 times too slow. Mind you these models take in lots of sensor data and spit out trajectories in a tight feedback loop.
Post reply on HN