Habitat: A fast 3D simulator for embodied AI research

#1

Post by abhshkdz » Wed, Feb 27, 2019, 5:46 PM UTC

Habitat: A fast 3D simulator for embodied AI research
facebook.com

Re: Habitat: A fast 3D simulator for embodied AI research

#2

Post by abhshkdz » Wed, Feb 27, 2019, 5:46 PM UTC

https://aihabitat.org/

https://github.com/facebookresearch/habitat-sim

https://github.com/facebookresearch/habitat-api

Re: Habitat: A fast 3D simulator for embodied AI research

#3

Post by warghharrrbl » Thu, Feb 28, 2019, 11:04 AM UTC

Not sure why "photorealistic" is such a big selling point here. If we can make robots navigate in DOOM they will probably be able to navigate in Habitat and vice versa.

Low on technical detail. What can this do that Gazebo cannot?

Re: Habitat: A fast 3D simulator for embodied AI research

#4

Post by warghharrrbl » Thu, Feb 28, 2019, 11:12 AM UTC

warghharrrbl wrote: post #3

Not sure why "photorealistic" is such a big selling point here. If we can make robots navigate in DOOM they will probably be able to navigate in Habitat and vice versa. Low on technical detail. What can this do that Gazebo cannot?

More confusion. Looking closer at the actual code, there are actually do?

Re: Habitat: A fast 3D simulator for embodied AI research

#5

Post by abhshkdz » Thu, Feb 28, 2019, 1:55 PM UTC

warghharrrbl wrote: post #3

Not sure why "photorealistic" is such a big selling point here. If we can make robots navigate in DOOM they will probably be able to navigate in Habitat and vice versa. Low on technical detail. What can this do that Gazebo cannot?

Not quite. Real-world environments (which Habitat is aiming to be a close-enough proxy for along the computer vision axis) are far more visually complex than what Doom allows for.

Re: Habitat: A fast 3D simulator for embodied AI research

#6

Post by abhshkdz » Thu, Feb 28, 2019, 2:01 PM UTC

warghharrrbl wrote: post #4

warghharrrbl wrote: post #3

Not sure why "photorealistic" is such a big selling point here. If we can make robots navigate in DOOM they will probably be able to navigate in Habitat and vice versa. Low on technical detail. What can this do that Gazebo cannot?

More confusion. Looking closer at the actual code, there are actually do ?

From what I understand, this is not a physics engine (at least in its current form). This is a bare metal 3D environment rendering engine particularly optimized for speed; speed being especially important for training deep reinforcement learning agents for instance.

Physics would be a layer above this; I imagine Bullet can be integrated within Habitat, but will come with significant hit on speed. These choices depend quite a bit on the task being studied.