Figure 01 robot demos its OpenAI integration
twitter.com
Figure 01 robot demos its OpenAI integration
1–10 of 116 posts
Re: Figure 01 robot demos its OpenAI integration
#2The ability to translate between text to servo movement is unreal, and it looks like gpt4 vision + whisper are heavily used. They're also using the term "reasoning" which is... new.
Can you call this an AI wrapper company? Kinda! The medium is a little different than an app, of course.
Lots of amazing applications of AI even if frontier AI development froze today.
Re: Figure 01 robot demos its OpenAI integration
#3Interesting stutter at 0:53
Re: Figure 01 robot demos its OpenAI integration
#4[deleted]
Re: Figure 01 robot demos its OpenAI integration
#5The ability to translate between text to servo movement is unreal, and it looks like gpt4 vision + whisper are heavily used. They're also using the term "reasoning" which is... new. Can you call this an AI wrapper company? Kinda! The medium is a little different than an app, of course. Lots of amazing applications of AI even if frontier AI development froze today.
> text to servo movement
yeah this was super impressive. If this is at the point where you can put an arbitrary object in front of it and ask it to move it somewhere, that's going to be huge for industrial automation type stuff I'd imagine.
I do wonder how much of that demo was pre-baked/trained though. Could they repeat the same thing with a banana? What if the table was more cluttered? What if there were two people in the frame?
Re: Figure 01 robot demos its OpenAI integration
#6Interesting stutter at 0:53
Similar at 1:47 I... I think
It sounds so human, a person would also stutter at an introspective question like this. I wonder if their text to speech was trained on human data and produces these artifacts of human speech, or if it is intentional.
Re: Figure 01 robot demos its OpenAI integration
#7This humanoid form plus the voice really gives of a different feeling than the pure chat version. I think it will feel even more profound if they can add eyes and eye contact. Imagining demoing this to a random person.
Re: Figure 01 robot demos its OpenAI integration
#8Interesting stutter at 0:53
Similar at 1:47 I... I think It sounds so human, a person would also stutter at an introspective question like this. I wonder if their text to speech was trained on human data and produces these artifacts of human speech, or if it is intentional.
I use ChatGPT voice a lot, and it is prone to this exact type of stutter. I don’t think it’s intentional. I think there are certain phonetic/tonal linkages that are naturally “weird” (uncommon in the training corpus) and that AI struggle with them. Why this struggle manifests as a very human-like stutter is a fascinating question.
Re: Figure 01 robot demos its OpenAI integration
#9Interesting stutter at 0:53
Similar at 1:47 I... I think It sounds so human, a person would also stutter at an introspective question like this. I wonder if their text to speech was trained on human data and produces these artifacts of human speech, or if it is intentional.
I'm not sure when OpenAI added them, but you can hear similar things when using the ChatGPT voice mode on iOS. Sometimes it feels almost like a latency stutter and other times it feels intentionally human.
Re: Figure 01 robot demos its OpenAI integration
#10Interesting stutter at 0:53
OpenAI's TTS does this. You can hear it in regular ChatGPT's voice mode (which this demo is based on, it uses the same animations on the robot's face). It will also sometimes randomly hallucinate syllables or whole nonsense words, although that is rarer.