Live data from Hacker News

AirSim: open-source simulator for autonomous vehicles

github.com

31–40 of 57 posts

Re: AirSim: open-source simulator for autonomous vehicles

#31
post #21

In theory, could I use this (or something like it) to develop algorithms for controlling autonomous vehicles (aerial, ground, and/or aquatic), then if I ever get my experimentation to the point that I’m interested in doing so, building the vehicle itself and deploying it with a reasonable degree of confidence that it would actually work?

getting things like this to transfer well is not necessarily easy, it’s a major active area of research. even if you somehow had a perfect physics model, there are problems like the fact that motors and joints behave differently as they wear down, etc. it might be easier for wheeled vehicles — usually the examples of failure are complicated, error-prone things like bipedal walking, hands with lots of joints.

Yeah the trick is knowing what the performance of the as-built vehicle will be before building it. You can to some extent marginalize over this by running randomized trials with different parameters for your mechanisms so that you verify that you're not too sensitive to the exact setup. The control system needs to be fairly robust to such variations. But you still don't know that you've modeled all the physics correctly until it's actually flight-proven. Picking the correct degree of fidelity in a simulation model isn't super straightforward.

Re: AirSim: open-source simulator for autonomous vehicles

#33
post #14

looked at using airsim a few months ago to replace a product we'd been using for some time, problem was the actual vehicle dynamics simulation capabilities were subpar

Airsim also has poor facilities for stepped simulation needed for many RL algorithms (e.g. insert control, advance simulator by 30ms, observe state, repeat). It looks like this is still being worked on: https://github.com/microsoft/AirSim/issues/600

Weird, I'm surprised that isn't the default mode of operations for something that's designed to plug in your own control system.

Re: AirSim: open-source simulator for autonomous vehicles

#35
post #21

In theory, could I use this (or something like it) to develop algorithms for controlling autonomous vehicles (aerial, ground, and/or aquatic), then if I ever get my experimentation to the point that I’m interested in doing so, building the vehicle itself and deploying it with a reasonable degree of confidence that it would actually work?

getting things like this to transfer well is not necessarily easy, it’s a major active area of research. even if you somehow had a perfect physics model, there are problems like the fact that motors and joints behave differently as they wear down, etc. it might be easier for wheeled vehicles — usually the examples of failure are complicated, error-prone things like bipedal walking, hands with lots of joints.

My thinking is that if your sim is kinda realistic, then once it works you can fine tune on some (expensive) real hand labeled data. But the sim helps you develop the training process etc.

Re: AirSim: open-source simulator for autonomous vehicles

#36
I just downloaded this last weekend! I’m trying to find a good simulator where I can import models generated with photogrammetry. I’ve been using a cell phone camera and OpenSfM + OpenMVS to make 3D models of real world environments, and I want to be able to run them in sim. I see this is built on Unity. In the past I tried UnrealEngine but it was such a big mess of software for simple RL tasks. I’ll have to see if Unity is cleaner.

I’m building a mostly 3D printed four wheel drive Rover vehicle I designed, and I’m using an Nvidia Jetson Xavier to try to make it autonomous using only cameras for sensors. Currently I’ve got some stereo cameras but I’m considering a synchronized 4 X 4K camera rig. Hopefully I can release some scans once I get something good.

The rover is public domain open source so please check it out if you’re curious! It can support a 10-20lb payload with the right springs:

https://youtu.be/ToGT3KokPZA

Re: AirSim: open-source simulator for autonomous vehicles

#37
That looks interesting, but I wonder how accurate the flight behavior is when they are not including any atmospheric dynamics. The wind in the atmospheric boundary layer is characterized by strong semi-random fluctuations that arise from the turbulent interactions of the air with the surface. These fluctuations occur on scales both larger and smaller than a drone, so they should have a significant effect on its aerodynamics.

Re: AirSim: open-source simulator for autonomous vehicles

#38
post #12

I just ran across Real Engine looking for Architectural Visualization software (note that Twinmotion is free until Nov!) This is an amazing space which I imagine will explode in variety of application, especially once VR goes mainstream. Are there any open source alternatives which even come close? I wonder if I would attract attention if I were to upload a rendering of Saudi oil infrastructure for drone simulation.…

> I just ran across Real Engine looking for Architectural Visualization software (note that Twinmotion is free until Nov!)

Thank you!

Re: AirSim: open-source simulator for autonomous vehicles

#39
post #25

Earlier quoted context omitted.

Or pictures of people on the sides of sprinter vans. Or bikes on trailers on the backs of cars. Or pickup trucks stuffed to the gills with Lime scooters. Or...

It's good that it's open source then ;)

Good that autonomous driving companies won't pay me for my contribution to the software that underpins their R&D?

Re: AirSim: open-source simulator for autonomous vehicles

#40
post #15

Super cool. I've always been a big fan of generating synthetic training data. As long as you can degrade/distort the data to match real world conditions, you can have your cake and eat it to: accurate inputs with perfect automated labels. At my last job, we read the contents of receipts and parsed them for purchase information. I was really interested in working there, so I built a docker-based CGI receipt-generator[…

This is really cool! Nice work. Do you remember how you went about creating the original receipt generator? I'd be really interested in this kind of stuff without any ML/DL.
Post reply on HN