Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Helix: A vision-language-action model for generalist humanoid control

figure.ai

Post reply on HN
Print view View original

71–80 of 178 posts

Re: Helix: A vision-language-action model for generalist humanoid control

#71

Post by lyu07282 »

swalsh wrote: post #60

At this point, this is enough autonomy to have a set of these guys man a howitzer (read as old stockpiles of weapons we already have). Kind of a scary thought. On one hand, I think the idea of moving real people out of danger in war is a good idea, and as an American i'd want Americans to have an edge... and we can't guarantee our enemies won't take it if we skip it, on the other hand I have a visceral reaction to ma…

I don't understand we already saw exactly what happens with the emergence of drones and Israel is already using AI to select bombing targets and semi-autonomous turrets. What conversation? What kind of society do you think we are living in?

Re: Helix: A vision-language-action model for generalist humanoid control

#72

Post by silentwanderer »

causal wrote: post #67

I'm always wondering at the safety measures on these things. How much force is in those motors? This is basically safety-critical stuff but with LLMs. Hallucinating wrong answers in text is bad, hallucinating that your chest is a drawer to pull open is very bad.

In terms of low-level safety, they can probably back out forces on the robot from current or torque measurement and detect collisions. The challenge comes with faster motions carrying lots of inertia and behavioral safety (e.g. don't pour oil on the stove)

Re: Helix: A vision-language-action model for generalist humanoid control

#73

Post by Philip-J-Fry »

luma wrote: post #57
camjw wrote: post #21

Earlier quoted context omitted.

Maybe I don't understand exactly what you're describing but why would anyone pay for this? When I bring home the shopping I just... chuck stuff in the cupboards. I already know where it all goes. Maybe you can explain more?

> why would anyone pay for this? Presumably, they won't as this is still a tech demo. One can take this simple demonstration and think about some future use cases that aren't too different. How far away is something that'll do the dishes, cook a meal, or fold the laundry, etc? That's a very different value prop, and one that might attract a few buyers.

The person you're replying to is referring to the GP. The GP asks for an AI that tells them where to put their shopping. Why would anyone pay for THAT? Since we already know where everything goes without needing an AI to tell us. An AI isn't going to speed that up.

Re: Helix: A vision-language-action model for generalist humanoid control

#74

Post by rizky05 »

cess11 wrote: post #68
causal wrote: post #67

I'm always wondering at the safety measures on these things. How much force is in those motors? This is basically safety-critical stuff but with LLMs. Hallucinating wrong answers in text is bad, hallucinating that your chest is a drawer to pull open is very bad.

Not a big deal on the battlefield.

[dead]

Re: Helix: A vision-language-action model for generalist humanoid control

#75

Post by mmh0000 »

causal wrote: post #67

I'm always wondering at the safety measures on these things. How much force is in those motors? This is basically safety-critical stuff but with LLMs. Hallucinating wrong answers in text is bad, hallucinating that your chest is a drawer to pull open is very bad.

The thing in the video moves slower than the sloth in Zootopia. If you die by that robot, you probably deserve it.

Re: Helix: A vision-language-action model for generalist humanoid control

#76

Post by mmh0000 »

ziofill wrote: post #6

There’s nothing I want more than a robot that does house chores. That’s the real 10x multiplier for humans to do what they do best.

It's called a "house cleaner" and they only cost ~$150 (area and all varies) bi-weekly. I'll shit a brick (and then have the robot clean it up) if a robot is ever cheaper than ~$4000/yr.

Re: Helix: A vision-language-action model for generalist humanoid control

#77

Post by __MatrixMan__ »

gopher_space wrote: post #64
__MatrixMan__ wrote: post #55

Earlier quoted context omitted.

It would be nice to be able to select a recipe and have it populate your shopping list based on what is currently in your cupboards. If you just chuck stuff in the cupboards then you have to be home to know what they contain. Or you could wear it while you cook and it could give you nutrition information for whatever it is you cooked. Armed with that it could make recommendations about what nutrients you're likely de…

Maybe I’m showing my age, but isn’t this a home ec class?

I took home ec in 2001. I learned to use a sewing machine, it was great.

But none of the kitchen stuff we learned had anything to do with ensuring that this week's shopping list ensures that you'll get enough zinc next week, or the kind of prep that uses the other half of yesterday's cauliflower in tomorrow's dinner so that it doesn't go bad.

These aren't hard problems to solve if you've got time to plan, but they are hard to solve if you are currently at the grocery store and can't remember that you've got a half a cauliflower that needs an associated recipe.

Re: Helix: A vision-language-action model for generalist humanoid control

#78

Post by vessenes »

mmh0000 wrote: post #76
ziofill wrote: post #6

There’s nothing I want more than a robot that does house chores. That’s the real 10x multiplier for humans to do what they do best.

It's called a "house cleaner" and they only cost ~$150 (area and all varies) bi-weekly. I'll shit a brick (and then have the robot clean it up) if a robot is ever cheaper than ~$4000/yr.

A robot will definitely cost less than $30/hr eventually. But you'll be running it a lot more than a few hours every other week.

Re: Helix: A vision-language-action model for generalist humanoid control

#79

Post by RedNifre »

lucianbr wrote: post #25
wwwtyro wrote: post #15

Until we get robots with really good hands, something I'd love in the interim is a system that uses _me_ as the hands. When it's time to put groceries away, I don't want to have to think about how to organize everything. Just figure out which grocery items I have, what storage I have available, come up with an optimized organization solution, then tell me where to put things, one at a time. I'm cautiously optimistic…

You want to outsource thinking to a computer system and keep manual labor? You do you, but I want the opposite. I want to decide what goes where but have a robot actually put the stuff there.

I think he means outsourcing everything eventually, but right now, outsourcing the thought process is possible, while outsourcing the manual labor is not.

Re: Helix: A vision-language-action model for generalist humanoid control

#80

Post by causal »

mmh0000 wrote: post #75
causal wrote: post #67

I'm always wondering at the safety measures on these things. How much force is in those motors? This is basically safety-critical stuff but with LLMs. Hallucinating wrong answers in text is bad, hallucinating that your chest is a drawer to pull open is very bad.

The thing in the video moves slower than the sloth in Zootopia. If you die by that robot, you probably deserve it.

Are you saying it cannot move faster than they because of some kind of governor?
Post reply on HN