Live data from Hacker News

Mistral's Robostral Navigate: a state of the art robotics navigation model

mistral.ai

61–70 of 117 posts

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#61
The multi-sensor comments are confusing. This issue is a command->semantic understanding problem, not a sensor fusion problem or trajectory planning problem per se.

It's not like the true depth of field is important for the robot to plan when it's moving at turtle speed and can stop quickly.

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#62
What is the realistic path to getting to play with this? I would love to hook this up to OpenClaw for hobbyist exploration. My dream has been to embody OpenClaw into a farm robot (been looking at adapting one of those RC lawnmowers that is tracked and built for mowing steep hills) so that I can assign it various tasks around our acreage -- "Explore the fenceline take pictures of the plants. Find all of the poison ivy and invasive honeysuckle and spray it with your Roundup sprayer. Repeat this every week and report the species map after every pass. Come back to the barn and charge yourself whenever you get low."

It's not hard to put OpenClaw into a robot body (numerous YouTube videos showing people doing this sort of thing), but when you dig in and see what people have done, the actual movement portion is always the clunkiest part (and this matches my own experiments as-such as well). It feels like an 8B model like this would be perfect for solving pathing and navigation issues.

Anyone who may be more experienced with Mistral (or companies like them) -- are they interested in hobbyist builders who would be experimenting with things like this? Or are they primarily looking for commercial partners? I would be willing to pay a license fee to use the model in my experiments, but if I'm just one guy, I'm not sure they'd want to work with me unless I were building a business out of it (which I'm not).

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#63

It's implied, and I'm hoping it's true, that this is a map-less navigation. Which is impressive. This kind of task is much easier if you have a pre-captured map of the environment, but if they are doing this without a map it's great. Historically you were always faced with "The Kidnapped Robot" problem where robots that didn't know where they were couldn't navigate even a little bit. Here the robot appears to be able…

I am working in Mistral robotics team. I confirm this is map-less. The only inputs are the text prompt and the front camera rgb image.

Are you interested in working with partners that are collecting training data?

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#64
This is honestly such a great direction (or at least hedge) for Mistral. They are already a great fit for EU companies, and are establishing a good relationship with them.

If they can stand up a robotics software platform without US or China cloud ties, pair it with robotics hardware that is already in the process of commoditization, they'll be running in open doors in the EU manufacturing/logistics sector.

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#66

I wonder how Mistral will prioritize its robotic development against its LLM development. We have either players that prioritize both (Google, AMI), or players that prioritize coding and agentic (OpenAI, Anthropic, ...).

Technically OpenAI has a robotics development team. In the past they were the creator and maintainer of the Gym reinforcement learning library, and they continue to do work and hire for it. It's just not the star of the show

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#67

It's implied, and I'm hoping it's true, that this is a map-less navigation. Which is impressive. This kind of task is much easier if you have a pre-captured map of the environment, but if they are doing this without a map it's great. Historically you were always faced with "The Kidnapped Robot" problem where robots that didn't know where they were couldn't navigate even a little bit. Here the robot appears to be able…

Would be extremely interesting to build an "Exploration" node of sorts. Solve a sort of Semantic SLAM problem as you go.

So if you can give it an instruction to "Find the elevator on this floor", could it walk around and build a map as it goes so it starts doing what a human would do to find the elevator.

As of now, the way these navigation models are setup, it assumes the instruction writer was intimately aware of useful visual navigational landmarks to give, which is not realistic for most use cases.

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#68
post #59

Earlier quoted context omitted.

I am working in Mistral robotics team. I confirm this is map-less. The only inputs are the text prompt and the front camera rgb image.

Please oh please try to make Kärcher adopt your stuff. Even their latest premium cleaning bots are hopeless when they don't know where they are, even when I tell them where they are. Or, I don't know, make your own vacuums.

I have no hope for this working. I recently bought a dumb meatbag operated vacuum after tiring of the robot's issues. The constant getting stuck in places drove me crazy. After getting a new vac, I used it in a place where the robot had just "cleaned" that morning. According to the new collector's contents, the robot sucked at its job of sucking.

Re: Mistral's Robostral Navigate: a state of the art robotics navigation model

#69

It's implied, and I'm hoping it's true, that this is a map-less navigation. Which is impressive. This kind of task is much easier if you have a pre-captured map of the environment, but if they are doing this without a map it's great. Historically you were always faced with "The Kidnapped Robot" problem where robots that didn't know where they were couldn't navigate even a little bit. Here the robot appears to be able…

I am working in Mistral robotics team. I confirm this is map-less. The only inputs are the text prompt and the front camera rgb image.

Nice! Thanks for confirming. If the last instruction is 'go back to where you started' does it work?
Post reply on HN