Live data from Hacker News

Helix: A vision-language-action model for generalist humanoid control

figure.ai

61–70 of 178 posts

Re: Helix: A vision-language-action model for generalist humanoid control

#62

"The first time you've seen these objects" is a weird thing to say. One presumes that this is already in their training set, and that these models aren't storing a huge amount of data in their context, so what does that even mean?

So from what I understand it actually means that they were for example never trained on a video of an apple. Maybe only on a video of bread, pineapple, chocolate.

However, as it was trained using generic text data similarly to a normal LLM, it knows how an apple is supposed to look like.

Similar than a kid that never saw a banana, but his parent described it to him.

Re: Helix: A vision-language-action model for generalist humanoid control

#63
post #15

Until we get robots with really good hands, something I'd love in the interim is a system that uses _me_ as the hands. When it's time to put groceries away, I don't want to have to think about how to organize everything. Just figure out which grocery items I have, what storage I have available, come up with an optimized organization solution, then tell me where to put things, one at a time. I'm cautiously optimistic…

You want to outsource thinking to a computer system and keep manual labor? You do you, but I want the opposite. I want to decide what goes where but have a robot actually put the stuff there.

That's the problem, though - the computer is already better at thinking than you, but we still don't know how to make it good at arbitrary labor requiring a mix of precision and power, something humans find natural.

In other words: I'm sorry, but that's how reality turned out. Robots are better at thinking, humans better at laboring. Why fight against nature?

(Just joking... I think.)

Re: Helix: A vision-language-action model for generalist humanoid control

#64
post #21

Earlier quoted context omitted.

Maybe I don't understand exactly what you're describing but why would anyone pay for this? When I bring home the shopping I just... chuck stuff in the cupboards. I already know where it all goes. Maybe you can explain more?

It would be nice to be able to select a recipe and have it populate your shopping list based on what is currently in your cupboards. If you just chuck stuff in the cupboards then you have to be home to know what they contain. Or you could wear it while you cook and it could give you nutrition information for whatever it is you cooked. Armed with that it could make recommendations about what nutrients you're likely de…

Maybe I’m showing my age, but isn’t this a home ec class?

Re: Helix: A vision-language-action model for generalist humanoid control

#65
post #49

Earlier quoted context omitted.

This is called "watching YouTube tutorials". We've had it for decades.

But what if there's no YouTube tutorial for the exact AC unit you have and it doesn't look like any of the videos you checked out?

Then you are equally fucked as the AI will be, so no difference.

Case in point, I remember about ten years ago our washing machine started making noise from the drum bearing. Found a Youtube tutorial for bearing replacement on the exact same model, but 3 years older. Followed it just fine until it was time to split the drum. Then it turned out that in the newer units like mine, some rent-seeking MBA fuckers had decided more profits could be had if they plastic welded shut the entire drum assembly. Which was then a $300 replacement part for a $400 machine.

An AI doesn't help with this type of shit. It can't know the unknown.

Re: Helix: A vision-language-action model for generalist humanoid control

#66
post #15

Until we get robots with really good hands, something I'd love in the interim is a system that uses _me_ as the hands. When it's time to put groceries away, I don't want to have to think about how to organize everything. Just figure out which grocery items I have, what storage I have available, come up with an optimized organization solution, then tell me where to put things, one at a time. I'm cautiously optimistic…

You already have one: a brain.

Re: Helix: A vision-language-action model for generalist humanoid control

#67
I'm always wondering at the safety measures on these things. How much force is in those motors?

This is basically safety-critical stuff but with LLMs. Hallucinating wrong answers in text is bad, hallucinating that your chest is a drawer to pull open is very bad.

Re: Helix: A vision-language-action model for generalist humanoid control

#68
post #67

I'm always wondering at the safety measures on these things. How much force is in those motors? This is basically safety-critical stuff but with LLMs. Hallucinating wrong answers in text is bad, hallucinating that your chest is a drawer to pull open is very bad.

Not a big deal on the battlefield.

Re: Helix: A vision-language-action model for generalist humanoid control

#69
post #44
post #13

Earlier quoted context omitted.

What do humans do best?

I mean to use their time to pursue their passions and interests, not cleaning up the kitchen or making the bed or doing laundry...

Given time to "pursue their passions and interests", most people chose to turn their brain to soup on social media.

Re: Helix: A vision-language-action model for generalist humanoid control

#70
post #6

There’s nothing I want more than a robot that does house chores. That’s the real 10x multiplier for humans to do what they do best.

To me this is such a weird wish. Why would you not want to care for your home and the people living there? Why would you want to have a slave taking these activities from you?

I'd rather have less waged labour and more time for chores with the family.

Post reply on HN