21–30 of 85 posts
The video compression is very cool. And the small tricks like binning the mouse movements. Wonder how much data is generalizable across different UIs? ie how good will the model be at using Figma if it’s never seen it before but has seen a lot of Photoshop
Are the inverse dynamics and forward dynamics models trained separately? It sounds like if the inverse dynamics model is meant to extrapolate more training data, then perhaps all that means is it takes very little data to generalize directly with the forward dynamics model assuming the right architecture.
holy crap, this is so good. How did it get buried?
This looks extremely impressive, really deserves more attention here. Are the inverse dynamics and forward dynamics models trained separately? It sounds like if the inverse dynamics model is meant to extrapolate more training data, then perhaps all that means is it takes very little data to generalize directly with the forward dynamics model assuming the right architecture.
Really interesting breakdown, proper nerdsniped into this, thanks for the refreshing AI news outside of language models :)
holy crap, this is so good. How did it get buried?
Otherwise, very cool and exciting!