71–78 of 78 posts
Earlier quoted context omitted.
The industry has had several tools like this for year’s. it can be useful but it hasn’t caught on in the past
please give us urls to other open source tools the industry uses for this kind of work, thank you very much.
Blender. Performance capture is used just like it is in computer games but the 3D objects are shaded differently to give them a more 2D look.
It would be cool privacy-wise to have some sort of virtual webcam that could share such an animation rather than what the webcam actually sees.
This is fairly easy to wire up on Linux using v4l2loopback and pyfakewebcam. I am currently using a little setup that uses OpenCV to acquire frames from the real camera, TensorFlow/BodyPix to compute an alpha mask for the foreground (me) and then OpenCV again to transform and composite myself behind news desks and into car infotainment screens and the like, eventually writing it to a virtual webcam I can use from Zoo…
Earlier quoted context omitted.
This is fairly easy to wire up on Linux using v4l2loopback and pyfakewebcam. I am currently using a little setup that uses OpenCV to acquire frames from the real camera, TensorFlow/BodyPix to compute an alpha mask for the foreground (me) and then OpenCV again to transform and composite myself behind news desks and into car infotainment screens and the like, eventually writing it to a virtual webcam I can use from Zoo…
Do you have any more details written up anywhere on how you do this? That sounds like a great project.
Earlier quoted context omitted.
IOS has the animated animal characters that mimic gestures pretty well.
I was playing with OpenFrameworks and Kinect years ago, and you could pretty much do this, so I am curious why you would TF.js instead of simple OpenCV or other libraries that don't need to to use ML or DL. Or am I mistaken, and it is using simple bits of TS.js? We had a large, flip-disc (or dot) wall at the site in Macau in 2012 that we purchased from a company that was a wall of black and white discs or dots that w…
IIRC there was a similar thing done for one of the VR systems recently, but for the hands instead of for the face. Has anyone seen any open models or software for tracking hand shape and location in this way? I would love to use it in connection with sign language processing.
IIRC there was a similar thing done for one of the VR systems recently, but for the hands instead of for the face. Has anyone seen any open models or software for tracking hand shape and location in this way? I would love to use it in connection with sign language processing.
Yep! I do have something bookmarked somewhere. I use sign language myself and do want the same thing. Curious about your background
I studied linguistics and CS in school, and I learned a little JSL to speak with deaf friends in Japan. I think sign language processing is a really neat combination of computer vision/graphics and linguistics. Lately there have been so many great advances in speech processing, but there hasn't been a huge leap forward for sign language processing, though I feel there should be.
Deaf people are already really disadvantaged in many places, and getting left behind technologically doesn't help. I really resented looking for JSL books in the "disabled" section of the book stores in Japan, and when I spoke with some people about JSL, they didn't believe it was its own language. Even just linguistic work for sign languages is limited; I haven't seen a single reference grammar (re: comprehensive documentation) on any sign language. I think the difficulty of working with sign language data makes it more daunting to work with. (Paucity of speakers is certainly not a deterrent for linguists.)