Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made a computer vision addon for Blender

github.com

Post reply on HN
Print view View original

11–20 of 36 posts

Re: Show HN: I made a computer vision addon for Blender

#11

Post by emcq »

daenz wrote: post #8
morroida wrote: post #7

Earlier quoted context omitted.

Uou this is awesome! And it's very nicely presented in the website. I'm wondering how you mapped from the UV to the 3D model. I would like to add that feature to the addon.

It's been awhile since I've looked at the code, but take a look at the code around this https://github.com/amoffat/metabrite-receipt-tests/blob/mast... for mapping from UV space to image space TLDR: using a KD-tree, I find the face containing the UV coordinate. Then I transform the UV coordinate to barycentric coordinates within that containing face, then put that barycentric coordinate through the local -> world ->…

A common approach in rendering engines to convert screen space coordinates to objects is to render a second image with light and shadow disabled where the color uniquely maps to an id. You then can uniquely identify 24 bits worth of objects without needing to maintain a KD tree.

Re: Show HN: I made a computer vision addon for Blender

#12

Post by modeless »

daenz wrote: post #5

Very cool! I've done something similar for improving an OCR system on crinkled paper[0]. Blender is a powerful and totally underutilized tool for this kind of work 0. https://www.arwmoffat.com/work/synthetic-training-data

I've thought about doing this myself! Did it end up improving the OCR system for real world images?

Re: Show HN: I made a computer vision addon for Blender

#14

Post by santaclaus »

Very cool! Just the other day I was trying to set Blender’s camera based on a standard 3x4 computer vision KRT matrix, and it is surprisingly a pain in the ass —- I wish more of these graphics CAD packages (Blender, Houdini, Maya) made it easier to deal with vision data.

Re: Show HN: I made a computer vision addon for Blender

#15

Post by daenz »

modeless wrote: post #12
daenz wrote: post #5

Very cool! I've done something similar for improving an OCR system on crinkled paper[0]. Blender is a powerful and totally underutilized tool for this kind of work 0. https://www.arwmoffat.com/work/synthetic-training-data

I've thought about doing this myself! Did it end up improving the OCR system for real world images?

The startup ran out of money before we could find out :) It was sort of a skunkworks project.

Re: Show HN: I made a computer vision addon for Blender

#16

Post by morroida »

santaclaus wrote: post #14

Very cool! Just the other day I was trying to set Blender’s camera based on a standard 3x4 computer vision KRT matrix, and it is surprisingly a pain in the ass —- I wish more of these graphics CAD packages (Blender, Houdini, Maya) made it easier to deal with vision data.

I agree, these tools should have an official computer vision module since so many people are using synthetic data these days.

Re: Show HN: I made a computer vision addon for Blender

#17

Post by punnerud »

morroida wrote: post #6

So many likes, was not expecting that! I will be presenting this work tomorrow at MICCAI and then I will post my presentation link in the README of the repository!

Thank you for your work! Looking forward to the presentation.

I had to look up MICCAI. To others: 23rd INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING & COMPUTER ASSISTED INTERVENTION (4-8 OCTOBER 2020) https://www.miccai2020.org/en

Re: Show HN: I made a computer vision addon for Blender

#18

Post by bluejellybean »

Very, very cool work, I fully expect to use this exact project in the future!

To those of you who always thought this stuff looked neat but never tried it out, and to those who may have used blender in the past and gave up, I would HIGHLY encourage you to try again with the latest version of the software. Although there is still a bit of a learning curve, there have been massive improvements have to the software suite.

The ability to code audio/visual in blender is just incredible. I describe it like this: Imagine yourself as someone trying to code an image that looks like a tree in machine code. Then imagine your partner comes over, sees what you are working on, and hands you Python and a fully setup IDE, it's like being given literal magic.

I downloaded the latest version earlier this year to write some basic AI simulations (cube wars!) and to create models for my 3D-printer. Like when I first learned to code, the fun of the machine totally sucked me and I got completely off-task from my original goal. Lately I've been working on two things with the same lines of code, music videos and simulated walks through forests(Think the movie Avatar). With only a few hundred lines of code I am able to generate infinite forest trails in which you can walk (or fly a drone-style camera) through, synced to music that is generated by the AI-mushrooms WITHIN in the scene itself! Literally was able to go from 0 to highly visually engaging trippy music videos in the last year with minimial musical production experience and with no music-video production background. The ease in which you are able to generate things via code is stunning and the limits feel completely boundless.

Re: Show HN: I made a computer vision addon for Blender

#19

Post by bluejellybean »

doctoboggan wrote: post #10

This is awesome! I’ve been working with blender scripts a lot lately for my side project where I generate jewelry for 3D printing ( https://lulimjewelry.com ) It’s an incredibly powerful tool, IMO one of the best large open source applications. I’ve learned some good ideas by reading the plug-in here, thank you!

Really cool! I just sent you an email (I love your contact info on HN btw!)
Post reply on HN