I wish I was a 5 year old that didn't actually know how infeasible and useless this all is, and could just be positive about the future for once.
But humans cant even figure out you can't operate an "imaginary number go up" underneath the basic human requirement of rent for shelter, there is no way they can make this technology useful or affordable or reliable or good
Figure 01 robot demos its OpenAI integration
91–100 of 116 posts
Re: Figure 01 robot demos its OpenAI integration
#92Earlier quoted context omitted.
That delay will be eliminated very soon. IMO low latency natural voice conversations are going to be bigger than ChatGPT. It's going to blow people's minds when they can converse with these AIs casually just like with their real life friends. It won't be anything like Siri or Alexa anymore. Here's a demo from a startup in this space. Still very early. https://deck.sindarin.tech/
I’ll be thrilled when Siri can spell my wife’s name correctly after 13 years of continuous usage and explicitly training it in her name. Admittedly her name is wildly complicated and totally unknown to the software folks at Apple: Ada Also my radio-trained voice is so generic a caller every week-ish assumes I am a bot, so I’m pretty sure the problem isn’t me enunciation or accent.
> Admittedly her name is wildly complicated and totally unknown to the software folks at Apple: Ada
Aye.
I was surprised this morning when it decided I had was talking about a "Mark of chain". 1/3rd of the time it hears "bedroom 100%" as "bedroom off".
When cooking dinner today, I asked for a "ten minute timer", it responded "for how long?" then confirmed my "ten minute minute timer".
Still better than Alexa, which kept telling us it couldn't find «kitchen» on Spotify even though we didn't even have Spotify.
And way better than the voice control on Mac OS Classic; back in the late 90s/early 00s, it interpreted 75% of my attempts to use it as "tell me a joke" (it wasn't even a good joke), and ignored 20%.
Re: Figure 01 robot demos its OpenAI integration
#93Earlier quoted context omitted.
I suspect it's less pre-trained than you think, the tweet is prefaced with a message that all actions are driven by neural networks indicating that it's probably adjusting for the objects, the environment etc.
I think it's true that it can adjust, somewhat. I expect that it could handle slight variations such as moving any of the items on the table around by a few inches, or adding or removing a couple of plates from the rack. However, I do not expect that it could handle larger variations like replacing the apple with a pineapple, picking trash out of the dish rack or the cup instead of the plate, replacing the cup with a…
I'm sure there is definitely some limitation in this demo, but who knows, Google RT-2 exists after all. Enough shapes and object training will save the day, there's still objects me as a human would be new to handling.
Re: Figure 01 robot demos its OpenAI integration
#94Interesting stutter at 0:53
OpenAI's TTS does this. You can hear it in regular ChatGPT's voice mode (which this demo is based on, it uses the same animations on the robot's face). It will also sometimes randomly hallucinate syllables or whole nonsense words, although that is rarer.
Huh, TIL.
I noticed the stutter too, interesting to see that is what TTS just does now, and not a sign of a human and a sound filter.
Re: Figure 01 robot demos its OpenAI integration
#95Earlier quoted context omitted.
I think it's true that it can adjust, somewhat. I expect that it could handle slight variations such as moving any of the items on the table around by a few inches, or adding or removing a couple of plates from the rack. However, I do not expect that it could handle larger variations like replacing the apple with a pineapple, picking trash out of the dish rack or the cup instead of the plate, replacing the cup with a…
I'm sure there is definitely some limitation in this demo, but who knows, Google RT-2 exists after all. Enough shapes and object training will save the day, there's still objects me as a human would be new to handling.
Oh for sure these limitations will fall. It's only a matter of time (and a lot of work behind the scenes).
Covariant's RFM-1 (announced Monday) is an interesting approach to generality. https://www.youtube.com/watch?v=1Go6HEC-bYU
Re: Figure 01 robot demos its OpenAI integration
#96I wish I was a 5 year old that didn't actually know how infeasible and useless this all is, and could just be positive about the future for once. But humans cant even figure out you can't operate an "imaginary number go up" underneath the basic human requirement of rent for shelter, there is no way they can make this technology useful or affordable or reliable or good
Fully agreed. This is going to turn into novelty nonsense, like some fashion designer will have a robot runway event and it'll drum up a bunch of stupid press. Then the military will take the rest over into advancing drone technology.
Re: Figure 01 robot demos its OpenAI integration
#97Earlier quoted context omitted.
That delay will be eliminated very soon. IMO low latency natural voice conversations are going to be bigger than ChatGPT. It's going to blow people's minds when they can converse with these AIs casually just like with their real life friends. It won't be anything like Siri or Alexa anymore. Here's a demo from a startup in this space. Still very early. https://deck.sindarin.tech/
Hey there — I’m Brian, the founder of Sindarin, the company behind this pitch deck. This demo is pretty bad compared to what we currently have in development. We’ve been in code freeze in prod for over two months to get our substantially improved engine finished. It’ll be out in a few weeks, and it’ll blow this version away in every way that matters. Thanks for checking us out!
Make sure to post it on hacker news :)
Re: Figure 01 robot demos its OpenAI integration
#98Is the music and color correction deliberately designed to give off creepy sci fi vibes?
Re: Figure 01 robot demos its OpenAI integration
#99Selecting one of a set of pre-trained actions by voice is cool but not exactly ground-breaking. Using GPT-4V to describe a scene is also pretty simple. The most impressive things here to me are the speed of picking up the trash and the fluid passing of objects between hands. It's unclear how general these movement policies are though. The way that guy is standing perfectly still makes me think that it would fail if e…
At 1:37 in the video you can see it react by jerking its hand after the plate wobbles a bit.
At 0:59 it also shifts the basket out of the way as a separate action, after its already put it down.
Re: Figure 01 robot demos its OpenAI integration
#100Earlier quoted context omitted.
just add a hmmm before every response
Which we humans do all the time. Okay, like, so, hear me out, alright? See, what’s really going on, yeah, is…
Which is so cool because it's an evolutionary/language thing.
Why do we add junk words while we think? I think it's probably because we're social animals, we want to hold that person's attention as we think as periods of silence are likely to make them become disengaged. But who knows really.