This shows the real utility of the Groq low latency inference. That delay in responding makes it much less impressive (it’s still really impressive obviously!)
Figure 01 robot demos its OpenAI integration
11–20 of 116 posts
Re: Figure 01 robot demos its OpenAI integration
#12Interesting stutter at 0:53
OpenAI's TTS does this. You can hear it in regular ChatGPT's voice mode (which this demo is based on, it uses the same animations on the robot's face). It will also sometimes randomly hallucinate syllables or whole nonsense words, although that is rarer.
Is there a setting for this in the ChatGPT app? I have never once noticed it produce an "uh" or repeated syllable like "I... I think I did pretty well."
Re: Figure 01 robot demos its OpenAI integration
#13This shows the real utility of the Groq low latency inference. That delay in responding makes it much less impressive (it’s still really impressive obviously!)
That delay will be eliminated very soon. IMO low latency natural voice conversations are going to be bigger than ChatGPT. It's going to blow people's minds when they can converse with these AIs casually just like with their real life friends. It won't be anything like Siri or Alexa anymore.
Here's a demo from a startup in this space. Still very early. https://deck.sindarin.tech/
Re: Figure 01 robot demos its OpenAI integration
#14The speech to servo movement is impressive as others pointed out. What strikes me as amazing is the speed with which it is performing tasks that require dexterity. This is the first object manipulation robot demo I have seen that didn't require speeding up the video for it to look "natural".
Re: Figure 01 robot demos its OpenAI integration
#15Earlier quoted context omitted.
OpenAI's TTS does this. You can hear it in regular ChatGPT's voice mode (which this demo is based on, it uses the same animations on the robot's face). It will also sometimes randomly hallucinate syllables or whole nonsense words, although that is rarer.
Is there a setting for this in the ChatGPT app? I have never once noticed it produce an "uh" or repeated syllable like "I... I think I did pretty well."
Really? Have you used it much? I haven't used it a ton but it definitely says "uh" and has various other artifacts. Maybe they have improved it recently but it was quite obvious when I first got access. Or maybe some of the voices are more prone to it than others.
The naturalness of the speech is extremely good, though.
Re: Figure 01 robot demos its OpenAI integration
#16The ability to translate between text to servo movement is unreal, and it looks like gpt4 vision + whisper are heavily used. They're also using the term "reasoning" which is... new. Can you call this an AI wrapper company? Kinda! The medium is a little different than an app, of course. Lots of amazing applications of AI even if frontier AI development froze today.
> text to servo movement yeah this was super impressive. If this is at the point where you can put an arbitrary object in front of it and ask it to move it somewhere, that's going to be huge for industrial automation type stuff I'd imagine. I do wonder how much of that demo was pre-baked/trained though. Could they repeat the same thing with a banana? What if the table was more cluttered? What if there were two people…
Great question.
Boston Dynamics has been demoing the pre-baked dance routine for 2+ decades at this point. Really hoping we can evolve past it.
Re: Figure 01 robot demos its OpenAI integration
#17This shows the real utility of the Groq low latency inference. That delay in responding makes it much less impressive (it’s still really impressive obviously!)
Absolutely. People on X keep making the mistake of assuming cloud / network latency is the problem here.
The vast majority of America is within 10ms of a data center. That's nothing.
The current challenge for most interaction is ASR -> prompt processing latency. This will be improved with multimodal models on specialized hardware like Groq.
Re: Figure 01 robot demos its OpenAI integration
#18Someone, please ask OpenAI to stop artificially dumbing down ChatGPT by adding "um" to the audio output. I get that it is supposed to make it more human-like or something, but every time I hear it do that, I cringe and feel sad for humanity.
Re: Figure 01 robot demos its OpenAI integration
#19Related release about the deal:
Figure Raises $675M at $2.6B Valuation;Signs Collaboration Agreement with OpenAI
Re: Figure 01 robot demos its OpenAI integration
#20Omg. This is really impressive stuff!
I'm sure it's a bit cherry-picked and they chose things it is good at. But it is already showing some useful stuff.