71–75 of 75 posts
Why does Google actually build stuff like this? What is their actual end game and how does it relate to what they actually do as a business? They're an advertising company with a mission to "organize the worlds information", pivoting to robots? Do they need robots to organize the worlds information? No idea how big of a breakthrough this is, but it is absolutely undeniable that Googles PR team is going wild on anythi…
google runs on ad money but they're also in the business of acquiring elite ML talent and publishing sota research is one of the main drivers in accomplishing that.
I'm actually pretty bullish on humanoid robots like the Tesla bot - combination of LLMs, cheap batteries/motors/controllers from cars and vision research should be able to come together in useful and cheap ways in a few years, say 2030. $35K for a robot that can putter around the house doing basic stuff is just not that high of a bar. With a 10 year life span, that's $3.5k/year, or $10/day. Doing 1 hour of useful min…
They thing to keep in mind about the "Boston Dynamics approach" is that in order to solve the hardest real world problems, you need to do one of two things: 1) Overshoot the capabilities of the system so that it is robust when actually deployed subject to the uncertainty of the real world (e.g. motivating athletic intelligence). 2.) Grossly constrain your environment so that uncertainty is not a factor. This is (and has been) happening in warehouses and factories for decades.
Earlier quoted context omitted.
Are you taking about the unitree quadrupeds? Quadruped with an arm for <$1000 would be a steal. Got any recommendations?
With emphasis on "small" I got one called XGO mini 2 (and 1) that I sponsored on Kickstarter, which had it at half the price (400$ ish) but it's around $800 here[1]. It runs on Raspberry Pi which is a big +, as version 1 was running on custom hardware. People had to plug a Jetson Nano or other device to run their code (such as this [2]). It comes with their own App, connected via bluetooth, for simple commands too. I…
Does it has servos feedback too ?
Earlier quoted context omitted.
LLMs have terrible spatial awareness. This probably comes from ONLY being trained on text. I wonder if it would help a LLM running a robot to have a separate controller calculating it's position and what is around it, and feed that into the LLM constantly. It would be like when a video game has a radar display or map to let you know where you are in relation to other things.
I actually tried that a while back, giving 3.5-turbo a multishot prompt that consisted of distance readings for ahead, left, right and back in an array, as extracted from lidar data, then giving it movement instructions. It performed rather terribly. You've very much correct that their spatial awareness is terrible. Something as simple as drive forward, then back, turn left, etc. works just fine and they can generall…