Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral's Robostral Navigate: a state of the art robotics navigation model

mistral.ai

Post reply on HN
Print view View original

91–100 of 117 posts

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#91

Post by dang »

idiotsecant wrote: post #72
vga1 wrote: post #59

Earlier quoted context omitted.

Please oh please try to make Kärcher adopt your stuff. Even their latest premium cleaning bots are hopeless when they don't know where they are, even when I tell them where they are. Or, I don't know, make your own vacuums.

[flagged]

Can you please stop posting flamebait, unsubstantive comments, name-calling, shallow dismissals and the like? You've been doing these things repeatedly. It's not what this site is for, and destroys what it is for.

We've already asked you this a couple times. If you'd please review the site guidelines at https://news.ycombinator.com/newsguidelines.html and follow them, we'd appreciate it.

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#92

Post by felix_myuk »

HanClinto wrote: post #62

What is the realistic path to getting to play with this? I would love to hook this up to OpenClaw for hobbyist exploration. My dream has been to embody OpenClaw into a farm robot (been looking at adapting one of those RC lawnmowers that is tracked and built for mowing steep hills) so that I can assign it various tasks around our acreage -- "Explore the fenceline take pictures of the plants. Find all of the poison ivy…

Create a robot akin to OpenClaw with this would be cool, but it seems like for now the model is just for walking/understanding environment from text. What can you use to make the robot interact with the world?

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#93

Post by jgrizou »

duchenne wrote: post #39
iandanforth wrote: post #16

It's implied, and I'm hoping it's true, that this is a map-less navigation. Which is impressive. This kind of task is much easier if you have a pre-captured map of the environment, but if they are doing this without a map it's great. Historically you were always faced with "The Kidnapped Robot" problem where robots that didn't know where they were couldn't navigate even a little bit. Here the robot appears to be able…

I am working in Mistral robotics team. I confirm this is map-less. The only inputs are the text prompt and the front camera rgb image.

Do you think a similar model architecture could include some sort of memory, so a follow-up prompt of "Go back to the water foutain" would somehow work?

A in-model memory approach is probably still deep research but maybe a Rag-like pipeline could work in some instances

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#94

Post by horacemorace »

bee_rider wrote: post #90
idiotsecant wrote: post #87

Earlier quoted context omitted.

So the vacuum cleaner manufacturer would just require customers to install mistral on their local LLM hostbox? Or maybe they'd sell you a host to go with it you couldn't get into and honest cross fingers we aren't peeking!

It is an 8B model… so, I guess it probably couldn’t run directly on most existing vacuum robots, but it could be reasonable this decade, right? I wish we lived in the alternate universe where everybody has a home server that could run this sort of thing.

Once prices settle down it doesn’t seem unreasonable that everyone who wants modern conveniences plops down $3k for a home computer. It’s still cheaper than during the “home computer revolution” 80s/90s when normies were buying these at Sears and Radio Shack.

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#96

Post by bee_rider »

horacemorace wrote: post #94
bee_rider wrote: post #90

Earlier quoted context omitted.

It is an 8B model… so, I guess it probably couldn’t run directly on most existing vacuum robots, but it could be reasonable this decade, right? I wish we lived in the alternate universe where everybody has a home server that could run this sort of thing.

Once prices settle down it doesn’t seem unreasonable that everyone who wants modern conveniences plops down $3k for a home computer. It’s still cheaper than during the “home computer revolution” 80s/90s when normies were buying these at Sears and Radio Shack.

It would be nice to believe that could be possible, but people mostly switched to cheap laptops as soon as they became viable. No harm in being hopeful though.

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#97

Post by whatever1 »

aktenlage wrote: post #82

I'm impressed, because it is so minimalistic. On the other hand it reminds me of 2010ish robotic demo videos from academic researchers and willow garage. Problem with robotics is usually that it's easy to produce a good-enough looking demo, but it's really hard to make somethin work in the general case. As exemplified by autonomous driving.

Robotics is all about edge cases. There are so many applications where we have robots that can do 95% of the tasks flawlessly. Yet it’s not enough. This last 5% is so broad that it’s impossible to close

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#98

Post by ilaksh »

What are the possibilities for adding more high level tasks like "pick up the [arbitrary thing]"? I assume it's 100 times harder to deal with hands and arms in a generic way. But maybe for grippers with two claws it could be more tractable to just output two force vectors per claw or something for the grasp and another two fir the drop. And maybe the SDJ could do reverse kinematics or something.

But one RGB image wouldn't work. So maybe one would need a depth camera.

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#100

Post by adev_ »

BrandiATMuhkuh wrote: post #86

That is so awesome. I wish I had that 11 years ago during my Microsoft Research Internship. I had a NAO robot (from another great French company) and it walked to employees to motivate them to do some movements. To prevent long term injuries from being in the same position for too long. It had a visual compass but it didn't work. And just telling to "walk straight" clearly didn't work :D Here is the video in case som…

> I had a NAO robot (from another great French company) and it walked to employees to motivate them to do some movements.

One Toyota research center where I worked had robots that would go around the office and propose Snack to people.

While probably not being the most efficient way of using a robot, it definitively brought a smile on the face of many employees.

Post reply on HN