Live data from Hacker News

Show HN: I made a computer vision addon for Blender

github.com

1–10 of 36 posts

Re: Show HN: I made a computer vision addon for Blender

#2
Ok, this turned out to be far more interesting than the title here reads like. The little abstract at the top is far more informative:

> A Blender user-interface to generate synthetic ground truth data (benchmarks) for Computer Vision applications.

And it lets you make stereo images, depth maps, segmentation masks, surface normals and optical flow data from the rendered animation, and export it all in .npz numpy format. Quite interesting project.

Re: Show HN: I made a computer vision addon for Blender

#7
post #5

Very cool! I've done something similar for improving an OCR system on crinkled paper[0]. Blender is a powerful and totally underutilized tool for this kind of work 0. https://www.arwmoffat.com/work/synthetic-training-data

Uou this is awesome! And it's very nicely presented in the website. I'm wondering how you mapped from the UV to the 3D model. I would like to add that feature to the addon.

Re: Show HN: I made a computer vision addon for Blender

#8
post #7
post #5

Very cool! I've done something similar for improving an OCR system on crinkled paper[0]. Blender is a powerful and totally underutilized tool for this kind of work 0. https://www.arwmoffat.com/work/synthetic-training-data

Uou this is awesome! And it's very nicely presented in the website. I'm wondering how you mapped from the UV to the 3D model. I would like to add that feature to the addon.

It's been awhile since I've looked at the code, but take a look at the code around this https://github.com/amoffat/metabrite-receipt-tests/blob/mast... for mapping from UV space to image space

TLDR: using a KD-tree, I find the face containing the UV coordinate. Then I transform the UV coordinate to barycentric coordinates within that containing face, then put that barycentric coordinate through the local -> world -> view -> perspective transform matrices

Re: Show HN: I made a computer vision addon for Blender

#9
post #5

Very cool! I've done something similar for improving an OCR system on crinkled paper[0]. Blender is a powerful and totally underutilized tool for this kind of work 0. https://www.arwmoffat.com/work/synthetic-training-data

What the heck. This is beyond awesome I totally want to try it out

Re: Show HN: I made a computer vision addon for Blender

#10
This is awesome! I’ve been working with blender scripts a lot lately for my side project where I generate jewelry for 3D printing (https://lulimjewelry.com)

It’s an incredibly powerful tool, IMO one of the best large open source applications. I’ve learned some good ideas by reading the plug-in here, thank you!

Post reply on HN