Live data from Hacker News

Helix: A vision-language-action model for generalist humanoid control

figure.ai

131–140 of 178 posts

Re: Helix: A vision-language-action model for generalist humanoid control

#131

Goal 2 has been achieved, at least as a proof of concept (and not by OpenAI): https://openai.com/index/openai-technical-goals/

They can put away clutter but if they could chop a carrot or dust a vase they'd have shown videos demonstrating that sort of capability. EDIT: Let alone chop an onion. Let me tell you having a robot manipulate onions is the worst. Dealing with loose onion skins is very hard.

Sure. But if you showed this video to someone 5 or 10 years ago, they'd say it's fiction.

Re: Helix: A vision-language-action model for generalist humanoid control

#132
post #60

At this point, this is enough autonomy to have a set of these guys man a howitzer (read as old stockpiles of weapons we already have). Kind of a scary thought. On one hand, I think the idea of moving real people out of danger in war is a good idea, and as an American i'd want Americans to have an edge... and we can't guarantee our enemies won't take it if we skip it, on the other hand I have a visceral reaction to ma…

We had sufficient AI to make death machines for decades. You don't need fancy LLMs to get a pretty good success rate for targeting. I have said for years that the only thing keeping us from "stabby the robot" is solving the power problem. If you can keep a drone going for a week, you have a killing machine. Use blades to avoid running out of ammo. Use IR detection to find the jugular. Stab, stab and move on. I'm gues…

> We had sufficient AI to make death machines for decades

And we already reached the peek here. Small drones that are cheaply mass produced, fly on SIM cards alone and explode when they reached a target. That's all there is to it. You don't need a gun mounted on a spot or a humanoid robot carrying a gun. Exploding swarms are enough.

Re: Helix: A vision-language-action model for generalist humanoid control

#133
post #46

I don't know, there has been so many overhyped and faked demos in humanoid robotics space over the last couple years, it is difficult to believe what is clearly a demo release for shareholders. Would love to see some demonstration in a less controlled environment.

I suppose the next big milestone is Wozniak's Coffee Test: A robot is to enter a random home and figure out how to make coffee with whatever they have.

Re: Helix: A vision-language-action model for generalist humanoid control

#134
post #39
post #21

Earlier quoted context omitted.

Maybe I don't understand exactly what you're describing but why would anyone pay for this? When I bring home the shopping I just... chuck stuff in the cupboards. I already know where it all goes. Maybe you can explain more?

One use case I imagine is skilled workmanship. For example, putting on a pair of AR glasses and having the equivalent of an experienced plumber telling me exactly where to look for that leak and how to fix it. Or how to replace my brake pads or install a new kitchen sink. When I hire a plumber or a mechanic or an electrician, I'm not just paying for muscle. Most of the value these professionals bring is experience an…

Sounds like what Hololens was designed to solve, more in the AR space than AI though

Re: Helix: A vision-language-action model for generalist humanoid control

#135
post #15

Until we get robots with really good hands, something I'd love in the interim is a system that uses _me_ as the hands. When it's time to put groceries away, I don't want to have to think about how to organize everything. Just figure out which grocery items I have, what storage I have available, come up with an optimized organization solution, then tell me where to put things, one at a time. I'm cautiously optimistic…

I fully agree, building something like this is somewhere in my back log. I think the key point why this "reverse cyborg" idea is not as dystopian as, say, being a worker drone in a large warehouse where the AI does not let you go to the toilet is that the AI is under your own control, so you decide on the high level goal "sort the stuff away", the AI does the intermediate planning and you do the execution. We already…

I'm quite slowly working on something like this, but for time.

For "stuff" I think a bigger draw is having it so it can let me know "hey you already have 3 of those spices at locations x, y, and z, so don't get another" or "hey you won't be able to fit that in your freezer"

Re: Helix: A vision-language-action model for generalist humanoid control

#137
post #75
post #67

I'm always wondering at the safety measures on these things. How much force is in those motors? This is basically safety-critical stuff but with LLMs. Hallucinating wrong answers in text is bad, hallucinating that your chest is a drawer to pull open is very bad.

The thing in the video moves slower than the sloth in Zootopia. If you die by that robot, you probably deserve it.

They are designed to penetrate Holtzman shields, surely.

Re: Helix: A vision-language-action model for generalist humanoid control

#138
"Pick up anything: Figure robots equipped with Helix can now pick up virtually any small household object, including thousands of items they have never encountered before, simply by following natural language prompts."

If they can do that, why aren't they selling picking systems to Amazon by the tens of thousands?

Re: Helix: A vision-language-action model for generalist humanoid control

#139

"Pick up anything: Figure robots equipped with Helix can now pick up virtually any small household object, including thousands of items they have never encountered before, simply by following natural language prompts." If they can do that, why aren't they selling picking systems to Amazon by the tens of thousands?

Perhaps they are in the process of doing so?

Perhaps it's possible to grip them but not to pack them?

Re: Helix: A vision-language-action model for generalist humanoid control

#140

"Pick up anything: Figure robots equipped with Helix can now pick up virtually any small household object, including thousands of items they have never encountered before, simply by following natural language prompts." If they can do that, why aren't they selling picking systems to Amazon by the tens of thousands?

Most AI startups, like most startups in general, are in the business of selling futures. Much easier to get new seed $$$ once there’s a real hype around your demo. Not saying they aren’t being honest, just pointing out the logic of starting here and working your way up to a huge valuation.
Post reply on HN