The two-tower Mixture-of-Transformers design (autoregressive reasoner feeding a diffusion generator) is an interesting architectural bet.
Nvidia Cosmos 3
31–32 of 32 posts
Re: Nvidia Cosmos 3
#32Earlier quoted context omitted.
I have the GPU but no robot. What’s the minimum viable robot needed to play with this?
Not at all an expert but I believe it's possible to get started experimenting with just a simulated robot in the simulated world model. While the full workflow is to generate training data to drive a real robot in the real world, without closing the loop, you're just lacking the ground truth data to quantify the divergence between simulation and reality. There are all kinds of hobbyist robotic armatures at various pr…
Interesting! Yeah, that's quite expensive. For some reason I was thinking some of the useful cobots I had seen in the past were in the $10k range, but from a brief look around, that doesn't seem to be the case.