Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Figure 01 robot demos its OpenAI integration

twitter.com

Post reply on HN
Print view View original

101–110 of 116 posts

Re: Figure 01 robot demos its OpenAI integration

#101

Post by fragmede »

binoct wrote: post #80
fragmede wrote: post #73

Earlier quoted context omitted.

It is. Have you seen ok robot? https://ok-robot.github.io/

OK-Robot is super impressive, but there is a huge difference in the manipulation ability OK-Robot shows with a simple 1-DOF gripper and parallel-axis arm to pick up objects and place them largely on flat surfaces, and the human-analog arms and fingers of Figure 01 picking up a plate in both hands and placing it in the right slot in a drying rack, or dropping the apple into a person's moving hand. It would be absolute…

Yes, there are two half’s to this. This is being able to understand the command which OK robot shows is possible, and then there’s the control of motors and actuators as you pointed out. Not needing a team of engineers to laboriously write gcode to manipulate motors is part two and is the other astounding thing here. I haven’t been following this sort of thing, so I have no idea what previous state of the art was, so I can’t judge how much of an advancement it really is.

Re: Figure 01 robot demos its OpenAI integration

#102

Post by fnordpiglet »

DalasNoin wrote: post #7

This humanoid form plus the voice really gives of a different feeling than the pure chat version. I think it will feel even more profound if they can add eyes and eye contact. Imagining demoing this to a random person.

On mobile chatgpt if you press the headphones you can voice chat with that voice already

Re: Figure 01 robot demos its OpenAI integration

#103

Post by fnordpiglet »

EForEndeavour wrote: post #12
modeless wrote: post #10

Earlier quoted context omitted.

OpenAI's TTS does this. You can hear it in regular ChatGPT's voice mode (which this demo is based on, it uses the same animations on the robot's face). It will also sometimes randomly hallucinate syllables or whole nonsense words, although that is rarer.

Is there a setting for this in the ChatGPT app? I have never once noticed it produce an "uh" or repeated syllable like "I... I think I did pretty well."

I use the conversation mode (head phones icon) and it regularly says uh. It’s cute but spurious and unnecessary.

Re: Figure 01 robot demos its OpenAI integration

#104

Post by fnordpiglet »

iknownthing wrote: post #24

Interesting how it put the trash into the basket when that wasn't explicitly asked for.

One of the remarkable things about LLM IMO is its ability to perform something akin to abductive semantic reasoning, which this is an example of. It inferred probabilistically from the semantic context that’s the appropriate action. This is an absolutely remarkable ability of LLMs that IMO is the most important capability they bring to the table over all prior AI techniques.

(All usual caveats of stochastic parrots and non reasoning apply)

Re: Figure 01 robot demos its OpenAI integration

#105

Post by razodactyl »

lelag wrote: post #27

It's a really cool demo and I'm impressed by the dexterity of the robot, however I'm a bit underwhelm by what's shown here in the sense that the speech and reasoning capabilities is just obvious to anyone who's been paying attention and has experience with GPT4. The function calling was great, but it had a very simple "world" to interact with. It's really interesting to see it integrated with a robot that can interac…

I think the big deal here is that it's an end to end system.

It's very easy to forget the single line hallucinations of GPT3 not too long ago.

Look into providers like Groq that are running real-time inference with Transformer models.

It's only a matter of models improving then the hardware coming to market that this will be a major leap in robotic capabilities.

Re: Figure 01 robot demos its OpenAI integration

#106

Post by amorriscode »

penjelly wrote: post #82
modeless wrote: post #13

Earlier quoted context omitted.

That delay will be eliminated very soon. IMO low latency natural voice conversations are going to be bigger than ChatGPT. It's going to blow people's minds when they can converse with these AIs casually just like with their real life friends. It won't be anything like Siri or Alexa anymore. Here's a demo from a startup in this space. Still very early. https://deck.sindarin.tech/

demod this. The ability to interrupt the language model is very cool, However, i notice, it failed to move onto the next slide often. It could never get to the final slide without explicit mention to go there, and when i got to the last slide, i asked to go back to the first slide, it would say "ok lets go to the last slide" everytime, these are probably more control issues than language model issues but i thought id…

Totally agree on this take but the founder posted above you saying they have greatly improved their engine. Should be interesting to see!

Re: Figure 01 robot demos its OpenAI integration

#107

Post by golol »

beefnugs wrote: post #91

I wish I was a 5 year old that didn't actually know how infeasible and useless this all is, and could just be positive about the future for once. But humans cant even figure out you can't operate an "imaginary number go up" underneath the basic human requirement of rent for shelter, there is no way they can make this technology useful or affordable or reliable or good

I don't understand this negative sentiment. We are finally making progress on real physical robot labor. This has nothing to do with "imaginary number go up", this is about more labor being available to assemble, clean, transport, cook, cut, harvest, build, etc. i.e. things that really matter and are the bottlenecks to our livves being more comfortable.

This stuff is not infeasible, these robots can be built for the price of a car. There is still a ways to go from this to androids, but it is legitimately technologically feasible now.

Re: Figure 01 robot demos its OpenAI integration

#108

Post by shreezus »

batwood011 wrote: post #79
modeless wrote: post #13

Earlier quoted context omitted.

That delay will be eliminated very soon. IMO low latency natural voice conversations are going to be bigger than ChatGPT. It's going to blow people's minds when they can converse with these AIs casually just like with their real life friends. It won't be anything like Siri or Alexa anymore. Here's a demo from a startup in this space. Still very early. https://deck.sindarin.tech/

Hey there — I’m Brian, the founder of Sindarin, the company behind this pitch deck. This demo is pretty bad compared to what we currently have in development. We’ve been in code freeze in prod for over two months to get our substantially improved engine finished. It’ll be out in a few weeks, and it’ll blow this version away in every way that matters. Thanks for checking us out!

Super excited to follow your progress! I loved the SmarterChild throwback on your site, those sounds instantly triggered nostalgia.

Re: Figure 01 robot demos its OpenAI integration

#109

Post by empath-nirvana »

razodactyl wrote: post #105
lelag wrote: post #27

It's a really cool demo and I'm impressed by the dexterity of the robot, however I'm a bit underwhelm by what's shown here in the sense that the speech and reasoning capabilities is just obvious to anyone who's been paying attention and has experience with GPT4. The function calling was great, but it had a very simple "world" to interact with. It's really interesting to see it integrated with a robot that can interac…

I think the big deal here is that it's an end to end system. It's very easy to forget the single line hallucinations of GPT3 not too long ago. Look into providers like Groq that are running real-time inference with Transformer models. It's only a matter of models improving then the hardware coming to market that this will be a major leap in robotic capabilities.

I think it's always going to be the case that we'll get to AGI through a collection of neural networks and symbolic logic systems and not through just a single neural network. For some reason a lot of people think that's "cheating", though.

Re: Figure 01 robot demos its OpenAI integration

#110

Post by empath-nirvana »

gotrythis wrote: post #29
niek_pas wrote: post #21

Earlier quoted context omitted.

Funny, I have the exact opposite response. It does, indeed, make it seem more human-like to me.

I agree. That's the sad part. I want super-intelligence to sound intelligent and not artificially brought down to our level. :-)

What if it just inserts filler words when the text generation is too slow, to make it sound more natural. It's exactly what people do when they're thinking about what to say next.
Post reply on HN