Love it. Anybody use unreal engine with OpenAI gym yet?
UnrealCV
11–20 of 47 posts
Re: UnrealCV
#12Can someone explain what this is for? Is it so that computer vision researchers can create scenes in UE4 that can then be fed into their application?
[deleted]
Re: UnrealCV
#13Can someone explain what this is for? Is it so that computer vision researchers can create scenes in UE4 that can then be fed into their application?
You could use it to say, auto create large labeled data sets of images and their corresponding depth maps. Or generate large labeled data sets of objects and their segmentation masks. Or for training an autonomous agent (say self driving car) in a simulation environment
Re: UnrealCV
#14Re: UnrealCV
#15Anyone know of something similar for Unity? Unity has a bit of a steep learning curve of you want to do stuff like importing external data and working with outside programs
Re: UnrealCV
#16This is a great example of how we (collectively) are using virtual worlds as "dreams" for Deep learning. In the Deep Vision world we as a group are trying to segment, classify and reinforce our NN training on labeled real world data. The challenge is, it's a very manual process to label data - specifically images. The more that we can do inside the computer, for example automatically labeling pixels inside an image,…
It's not just for deep learning, it's for any computer vision research.
Synthetic datasets have been used in the past too, but this makes it much more accessible.
Re: UnrealCV
#17This is a great example of how we (collectively) are using virtual worlds as "dreams" for Deep learning. In the Deep Vision world we as a group are trying to segment, classify and reinforce our NN training on labeled real world data. The challenge is, it's a very manual process to label data - specifically images. The more that we can do inside the computer, for example automatically labeling pixels inside an image,…
It's not just for deep learning, it's for any computer vision research. Synthetic datasets have been used in the past too, but this makes it much more accessible.
Indeed...
However CV is becoming more and more Deep Net based.
Re: UnrealCV
#18I was hoping that this would be someone's really cool resume, but this is interesting, nonetheless.
Same here. I was thinking of how long it would take us before the inflation in fancy CVs and resumés would force recruitment agencies to invest in rendering farms and full-body VR suits in order to read job applications.
Re: UnrealCV
#19Can someone explain what this is for? Is it so that computer vision researchers can create scenes in UE4 that can then be fed into their application?
Yep, possibly. This approach has been successfully exploited in real-time SLAM for instance [1][2][3]
[1]http://link.springer.com/chapter/10.1007%2F978-3-642-33786-4... [2]http://www.doc.ic.ac.uk/~ahanda/VaFRIC/iclnuim.html [3]http://robotvault.bitbucket.org/
Re: UnrealCV
#20I thought about something like this for autonomous cars. The game engine could simulate all the sensors in a car. Then it would be possible to use this as training data. Would be fun to create a racing game out of it to let different algorithm compete against each other.
Does this already exist? Google should have something like this, but probably not freely available.