Live data from Hacker News

Gemini Robotics

deepmind.google

291–300 of 588 posts

Re: Gemini Robotics

#291
post #239

I'm a firmware engineer that's been working in consumer electronics and I feel very bleak about my future I feel so left behind. I have extremely limited robotics and computer vision experience. I have no ML experience. The only math I know has to do with basic signal processing. When I see open roles at these companies I think the projects I'm going to work on in the future will be more and more irrelevant to societ…

At least you're honest. I feel a lot of people (on HN esp) take pride in their programming ability and intelligence to the extent that they think there's no chance AI will take over their job. LLMs were a breakthough out of like a multitude of breakthroughs in AI in the past decade. I think there only needs to be a couple more breakthroughs in the next decade for it to come full circle. Whenever I here a naysayer ope…

When I see pro-AI promoters giving weird analogies that do not fit, I get a feeling that they are either management class(aka MBA types) or are not serious professionals.

One key point we must first understand, coding is NOT software engineering or even programming! Writing code is the last bit, a minimal fraction of the job description(unless you are actually indie dev or working for consulting firms). The core tasks include actually untangling the numerous vague requirements, understanding the domain, figuring out best approaches, performing various tests and checks, validating ideas, figuring out a cost effective solution, preparing rough architecture, deciding on an actual set of tech, align a hoard of people that everyone is on the same page, then start coding.

My IDE can already read my mind by auto-suggestion since many years and patterns/frameworks exist to reduce the amount of code I need to write. The issue is that, with these AI model, I just need to abuse my fingers slightly less. The other core duties are not yet solved and remains same archaic procedural everywhere in any/all serious roles.

And speaking of consulting firms, they are also clever and often has several implementations of same stuff, which they can modify a bit and sell for big money.

So in the end, people who jump into the pit because they are afraid of the juju mask are the prime target of the juju mask, for the rest of us, life goes on with minor bumps when the MBA comes to the desk and asks if it is possible to layoff few people to jack up the stock price this quarter yet… while subscribing to that new agenting engineer product suite for double the fees of what the laid off people actually costed, because their best friend in the golf club said the price will eventually become reasonable but the benefits are immediate.

Re: Gemini Robotics

#292
post #239

I'm a firmware engineer that's been working in consumer electronics and I feel very bleak about my future I feel so left behind. I have extremely limited robotics and computer vision experience. I have no ML experience. The only math I know has to do with basic signal processing. When I see open roles at these companies I think the projects I'm going to work on in the future will be more and more irrelevant to societ…

It definitely adds value to the conversation - we're all human, we're all unsure about the future and our place in it. I'm just scared about a future where humans (say the next generation, kids 1-5 years of age right now) lack in-depth knowledge of almost everything and it's mostly AI writing low-level code, so there are no more "human experts." We've already seen this happening where Gen Z mostly interacts with the…

Couldn't a similar argument be made about using a calculator? Hopefully, the tools created based on these new technologies will enable future generations to achieve things that perhaps we haven't even considered before.

Re: Gemini Robotics

#293
> The physical safety of robots and the people around them is a longstanding, foundational concern in the science of robotics. That's why roboticists have classic safety measures such as avoiding collisions, limiting the magnitude of contact forces, and ensuring the dynamic stability of mobile robots.

Uhhh, I mean that's nice, but how about: "That's why we will never sell our products to military, police, or other openly violent groups, and will ensure that our robots will always respond instantly to commands like, 'stop, you're hurting me', which they understand in every documented human language on earth, and with which they will comply regardless of who gave the previous command that caused violent behavior."

Who is building the robot cohort that is immune - down to the firmware level - to state coercion and military industry influence?

Re: Gemini Robotics

#294

question for the robot experts: what is the limitation that makes the movements so slow? for example when it picks up the ball and puts it in the basket. why couldn't that movement be done much faster?

Camera feed processing latency would be my guess. The system needs to make sense of a continuous video feed so moving slower reduces how much happens in between frames.

Re: Gemini Robotics

#295
post #239

I'm a firmware engineer that's been working in consumer electronics and I feel very bleak about my future I feel so left behind. I have extremely limited robotics and computer vision experience. I have no ML experience. The only math I know has to do with basic signal processing. When I see open roles at these companies I think the projects I'm going to work on in the future will be more and more irrelevant to societ…

It definitely adds value to the conversation - we're all human, we're all unsure about the future and our place in it. I'm just scared about a future where humans (say the next generation, kids 1-5 years of age right now) lack in-depth knowledge of almost everything and it's mostly AI writing low-level code, so there are no more "human experts." We've already seen this happening where Gen Z mostly interacts with the…

You see this with high level languages now. Memory management much less assembly are things of a bygone era.

Re: Gemini Robotics

#296
The upshot of this is that anyone will be able to order a couple of robot arms from China and then set them up in a garage, programming them with just text, like we do with LLMs now.

Time to think bigger.

Re: Gemini Robotics

#297
post #239

I'm a firmware engineer that's been working in consumer electronics and I feel very bleak about my future I feel so left behind. I have extremely limited robotics and computer vision experience. I have no ML experience. The only math I know has to do with basic signal processing. When I see open roles at these companies I think the projects I'm going to work on in the future will be more and more irrelevant to societ…

No worries. You know the hard part: dealing with hardware. ML/AI/Comp Vis can be learned fairly quickly if you don't need to dig very deep into algorithms by yourself, but use some higher level libs like scikit-learn, pytorch, etc.

The math, well, basic signal processing means you know some algebra and differential calculus. Which is enough, unless, again, you don't want to prove theorems or invent new algos.

Re: Gemini Robotics

#298

Earlier quoted context omitted.

I think the point GP is raising is that most of the robotic development in the past several decades has been on Motion Control and Perception through Visual Servoing. Those are realistically the 'natural' developments in the domain knowledge of Robotics/Computer Science. However, what GP (I think) is raising is the blind spot that robotics currently has on proprioception and tactile sensing at the end-effector as wel…

Ah, that's a really good point, thank you - makes me think of how little progress there's been in that domain, whether robots perceiving or tricking our perception. For the inverse of the robot problem: younger me, spoiled by youth and thinking multitouch was the beginning of a drumbeat of steady revolution, distinctly thought we were a year or two out from having haptics that could "fake" the sensation of feeling a…

I'm convinced the best haptics that I use every day are the "clicks" on the Macbook trackpad. You can only tell they're not real because they don't work when it's beachballing.

Re: Gemini Robotics

#299
post #239

I'm a firmware engineer that's been working in consumer electronics and I feel very bleak about my future I feel so left behind. I have extremely limited robotics and computer vision experience. I have no ML experience. The only math I know has to do with basic signal processing. When I see open roles at these companies I think the projects I'm going to work on in the future will be more and more irrelevant to societ…

Let me bring some perspective. In 1998, CMU was showing a self-driving car "driving on its own" [1]

27 years later, 99.99% of trips are driven by humans.

Real-world robotics takes multiple decades to pan out. These demos are just that: demos. What you are seeing will not remotely impact your life before the 2050's, if ever.

What you should be worried about, however, is you (not your job) becoming irrelevant if you don't learn to write firmware using state-of-the-art AI tooling.

At the minimum: learn to work with Cursor (or equivalent). Make sure you work at a company that uses state-of-the-art AI tooling.

If you want to go further: learn to code (e.g. in python). Take undergrad/grad level courses in math, statistics and fundamentals of deep learning.

And FFS, chill.

[1] https://www.youtube.com/watch?v=2KMAAmkz9go

Re: Gemini Robotics

#300

question for the robot experts: what is the limitation that makes the movements so slow? for example when it picks up the ball and puts it in the basket. why couldn't that movement be done much faster?

I'm not a robot expert, but I do know the answer is simply safety. Once it learns what to do, it can do it faster and faster, but when something goes very wrong, it will go very wrong.
Post reply on HN