Live data from Hacker News

Predator Object Tracking Algorithm

gottabemobile.com

41–50 of 81 posts

Re: Predator Object Tracking Algorithm

#41
post #8
post #5

Earlier quoted context omitted.

What if you just... email him and ask for it?

Don't really have a project, just curiousity...

I certainly intend to drop him an email and see if he's willing to share his stuff with an interested compsci undergrad. It's always worth asking - he's probably just doing it for metrics.

Re: Predator Object Tracking Algorithm

#42

Earlier quoted context omitted.

Depending on how well the computational load can be reduced to hardware small systems could provide for head mounted tracking systems He's clearly developing it on his laptop with a shitty webcam. That's why this is amazing. Screw robotic manufacturing, this is for my phone.

Phone != Laptop. It says he's running on a "Intel Core 2 Duo CPU 2.4 GHz, 2 GB RAM" according to his website. As a good rule of thumb, computer vision runs about an order of magnitude slower (10x) on a phone (like an iPhone) than on a desktop/laptop. Also - a crappy webcam actually makes things computationally easier because there's less data to deal with. In a lot of computer vision algorithms the first step is to t…

It says he's running on a "Intel Core 2 Duo CPU 2.4 GHz, 2 GB RAM" according to his website

I bet he isn't using the GPU though.

Also - a crappy webcam actually makes things computationally easier because there's less data to deal with

Perhaps, but lens distortion, motion blur and a rolling shutter don't make things easier.

Anyway, the inventor himself claims a phone implementation is feasible.

Re: Predator Object Tracking Algorithm

#43

Earlier quoted context omitted.

Spot on. There's a lot of current work going on that effectively splits computer vision into multiple parallel tasks for better results but uses previously well known techniques (PTAM is another good example). As an aside, I read through the paper and it doesn't look like this could track, say, your index finger separately from other fingers if, for a moment, your hand was occluded. This pretty much bars using this e…

I don't understand why everyone seems to have such a hardon for Minority Report-style systems. Gorilla arm pretty much rules that out from the start, and a tablet is more natural anyway. A trackpad with a separate screen would be optimal (so you don't have to look at your hands).

Yes using 2d displays in minority report was a huge mistake, but imagine it in 3d. Also that doesn't mean that you will have to keep your arms out before your eyes. Ideally you don't have to sit before your computer the whole day and use only a keyboard and a mouse, when you can have so much more freedom. Think of opening a book, ironing, or placing lego blocks etc.

Re: Predator Object Tracking Algorithm

#44
post #2

Bah! I was hoping to download the source (from here: http://info.ee.surrey.ac.uk/Personal/Z.Kalal/tld.html ) and check out his algorithm, but he requires you to email him with his project. If anyone knows how the algorithm works, or where it is described in detail, I'd love to read that! Absolutely amazing stuff!

Hopefully he will put it back, with a donation button ;)

Re: Predator Object Tracking Algorithm

#45
Interesting that TFA mentions "Minority Report-like interfaces" several times when: 1.) The Minority Report interface is the canonical example of a UI that is very impressive visually, and is beautifully mediagenic; but is hideously fatiguing and impractical in a real world scenario. (Hold your hand out at arm's length. Okay, now hold that pose for eight hours.) 2.) The MR UI has actually been commercialized, and has entirely failed to take the world by storm.

Also, computer vision demos are trivially easy to fake, and it's even easier to make an impressive demo video. You can have the guy who invented it spend a couple hours in front of the camera trying it over and over, then edit it down to three minutes of the system working perfectly. It wouldn't be nearly as impressive when you have an untrained user trying it live, in the field.

Re: Predator Object Tracking Algorithm

#46

Earlier quoted context omitted.

Phone != Laptop. It says he's running on a "Intel Core 2 Duo CPU 2.4 GHz, 2 GB RAM" according to his website. As a good rule of thumb, computer vision runs about an order of magnitude slower (10x) on a phone (like an iPhone) than on a desktop/laptop. Also - a crappy webcam actually makes things computationally easier because there's less data to deal with. In a lot of computer vision algorithms the first step is to t…

It says he's running on a "Intel Core 2 Duo CPU 2.4 GHz, 2 GB RAM" according to his website I bet he isn't using the GPU though. Also - a crappy webcam actually makes things computationally easier because there's less data to deal with Perhaps, but lens distortion, motion blur and a rolling shutter don't make things easier. Anyway, the inventor himself claims a phone implementation is feasible.

Yep, I'm sure he isn't. I don't doubt that you could optimize this algorithm to run on a phone but that takes an insane amount of effort and expertise and is a feat in and of itself. The word lens guys, for example, spent about a year porting from an optimized C implementation on i386 to ARM for the iPhone - they even initially used the GPU but decided that the overhead of shuffling data between buffers wasn't worth the advantage gained by the iPhone's measly GPU (which only had 2 fragment shaders at the time I think).

Also, completely agree on how camera blur would worsen the accuracy of said algorithm, I was trying to point out that it would run faster on a lower quality camera (with the caveat that it might not work nearly as well).

Re: Predator Object Tracking Algorithm

#47
post #40
post #3

Technical details here, with links to relevant papers at the bottom. http://info.ee.surrey.ac.uk/Personal/Z.Kalal/tld.html

Unfortunately you cannot download the source code, the link is disabled. And the GPL license he says he is using requires that the source code must be available for download without any restrictions like "send me an email" or "create an acount". Edit: I sent him an email :)

[deleted]

Re: Predator Object Tracking Algorithm

#48
post #37

Earlier quoted context omitted.

Phone != Laptop. It says he's running on a "Intel Core 2 Duo CPU 2.4 GHz, 2 GB RAM" according to his website. As a good rule of thumb, computer vision runs about an order of magnitude slower (10x) on a phone (like an iPhone) than on a desktop/laptop. Also - a crappy webcam actually makes things computationally easier because there's less data to deal with. In a lot of computer vision algorithms the first step is to t…

Specialized processing hardware != general-use CPU. Face tracking and image stabilization in dirt-cheap cameras is a good example, as is hardware video decoders or graphics cards. If a market emerges, specialized hardware will be built, and it'll be embeddable in just about anything.

Face tracking is a remarkable well solved problem these days.

I have only a vague understanding of the math behind how it works, yet I'm very successfully using it in an art project I'm playing with. An afternoon's Googling found me the OpenCV plugins for Processing and some face detection examples, and I've got a prototype that really disturbs my girlfriend - I call it "Death Ray" for extra creepiness factor[1] - but I've got a infra-red capable camera mounted on a pair of servos to steer it, and another pair of servos aiming a low power laser. An Ardunio driving the servos and switching that laser, with Processing just "magically" calling OpenCV for face detection in the video stream - _all_ the "heavy lifting" has been done for me - viva le open source!

[1] The thing that _really_ creeps the girl out is when I sit it all on top of the TV, and have it find faces watching the tv and paint "predator style aiming dots" onto peoples foreheads...

Re: Predator Object Tracking Algorithm

#49
post #20
post #10

This is massively ground breaking. You'll get it if you've used motion tracking on several game interfaces and had to make perfectly white backgrounds with bright lights to make it work. This is incredibly accurate - really game changing stuff.

Keep in mind that there's no report of the processing power required to do this in the video. It very well could be an algorithm that is extremely accurate, but at the expense of many CPU cycles. While it's obvious, remember that for use in games, you have to perform the detection and run the game in realtime. Whether or not this can be done with current hardware is what I'm interested in.

On the website he claims it's a fairly standard dual core setup and you can see the number of frames per second in the video. I noticed at one point it was staying around 15fps. It may not work at this point for an FPS (Especially because it would have to be done in conjunction with graphics and other game-related processes), but it would likely be fine with other less fast-paced games.

Re: Predator Object Tracking Algorithm

#50
post #40
post #3

Technical details here, with links to relevant papers at the bottom. http://info.ee.surrey.ac.uk/Personal/Z.Kalal/tld.html

Unfortunately you cannot download the source code, the link is disabled. And the GPL license he says he is using requires that the source code must be available for download without any restrictions like "send me an email" or "create an acount". Edit: I sent him an email :)

Doesn't the GPL only require you to release the code if you publicly release the software binaries? I was under the impression that if you only released the results (aka his research and papers) you aren't required to make the source open.
Post reply on HN