I thought this was going to be Unreal Curriculum Vitae, and it was going to be a playable resumé. I'm slightly disappointed.
UnrealCV
31–40 of 47 posts
Re: UnrealCV
#32I was hoping that this would be someone's really cool resume, but this is interesting, nonetheless.
I don't mean to criticise you personally, because I have done the same thing, but: Comments about what someone thought the title meant are very common and not interesting in any way.
I disagree. Most of the reason that people click on anything on this site is directly because of the title, so if I have particular expectations that the title fails to meet, then it's fair game for commenting. I don't think it's fair to assert that what you find common and uninteresting is irrelevant to someone else.
Re: UnrealCV
#33This is a brilliant idea, IMO, and a real game changer (in principle, not necessarily tied to the implementation). Without this, CV problems are largely only limited by how much data you can get. If you can simulate arbitrary scene configurations it's now possible to solve almost any non-human CV problem, even ones with sparse data.
For example, in security applications you have basically zero data on the sorts of anomalous events you want to trigger on. If you can simulate example cases of those things that means you can actually start applying supervised machine learning.
Re: UnrealCV
#34Does anybody know if there's a plugin for unreal, like this, but supports creating geometry inside the game? If not, is there a way of generating levels with code?
how do you want to create geometry? like loading an obj file and change its position? Unreal.js might worth a try.
Re: UnrealCV
#35This is a great example of how we (collectively) are using virtual worlds as "dreams" for Deep learning. In the Deep Vision world we as a group are trying to segment, classify and reinforce our NN training on labeled real world data. The challenge is, it's a very manual process to label data - specifically images. The more that we can do inside the computer, for example automatically labeling pixels inside an image,…
It's not just for deep learning, it's for any computer vision research. Synthetic datasets have been used in the past too, but this makes it much more accessible.
[deleted]
Re: UnrealCV
#36This is a great example of how we (collectively) are using virtual worlds as "dreams" for Deep learning. In the Deep Vision world we as a group are trying to segment, classify and reinforce our NN training on labeled real world data. The challenge is, it's a very manual process to label data - specifically images. The more that we can do inside the computer, for example automatically labeling pixels inside an image,…
I find this incredibly interesting. Do you have any more information on the subject you can point me to?
I created a project https://github.com/qiuwch/synthetic-computer-vision trying to summarize works that used synthetic data for computer vision. Might be worth to have a look.
Re: UnrealCV
#37Can someone explain what this is for? Is it so that computer vision researchers can create scenes in UE4 that can then be fed into their application?
You could use it to say, auto create large labeled data sets of images and their corresponding depth maps. Or generate large labeled data sets of objects and their segmentation masks. Or for training an autonomous agent (say self driving car) in a simulation environment
Exactly. That's the goal for this project.
Re: UnrealCV
#38This is a brilliant idea, IMO, and a real game changer (in principle, not necessarily tied to the implementation). Without this, CV problems are largely only limited by how much data you can get. If you can simulate arbitrary scene configurations it's now possible to solve almost any non-human CV problem, even ones with sparse data. For example, in security applications you have basically zero data on the sorts of an…
Many researchers have done interesting work using synthetic data (a lot of them are mentioned in this post). This tool just tries to make the creation of virtual world (which can be used by computer vision) easier.
Re: UnrealCV
#39Anyone know of something similar for Unity? Unity has a bit of a steep learning curve of you want to do stuff like importing external data and working with outside programs
The CVC lab and Virtual KITTI use Unity in their projects. They might have some internal tools. The advantage of UE4 is open-source, so that we can fully understand what the engine is doing.
Re: UnrealCV
#40Earlier quoted context omitted.
You could use it to say, auto create large labeled data sets of images and their corresponding depth maps. Or generate large labeled data sets of objects and their segmentation masks. Or for training an autonomous agent (say self driving car) in a simulation environment
Exactly. That's the goal for this project.
Many thanks for your work, will be putting it to use! Please consider integrating it with https://gym.openai.com/ for easy reinforcement learning tasks.
Some similar efforts (though not with open source engines)