Viewing profile — briggers

Machine learning productionization: https://paulbridger.com

Absolutely yes. I write fairly deep ML performance tuning articles at https://paulbridger.com and the (many) hours I've spent on each article have been hugely worth it. Many people…

Before you start optimizing runtime performance: measure, trace, inspect, or whatever is appropriate to understand current performance.

Perhaps you are looking for something like this? docker run -d -p 5000:5000 --name registry registry:2 https://docs.docker.com/registry/#:~:text=The%20Registry%20i... .

I used to love doing this with Clojure, it’s an awesome way to increase productivity by a good chunk. It’s less about saving the time to re-run something, and more about removing c…

Yes! I do this and love it. Works locally or via SSH with no difference at all.

Nice one! I've long been interested in the ONNX serving path.

Yeah. A 2080Ti doesn't fit in your pocket or in your AR glasses but the same techniques and tools scale down.

BTW, this is pumping the same video file through the network - not just a single file. I don't measure latency, but this is not a deep pipeline so it's easy to calculate.

Mobile phones definitely since these days most of them have pretty powerful GPUs.

Great question, now I wish I'd recorded power consumption for all these experiments. Judging from cumulative hours of watching the output of nvidia-smi I've definitely seen a linea…

Very practical question :) Exactly as you say, multi-stream throughput. Also for faster than realtime offline processing of video. Check the caveats section at the end of the post …

I looked into the GIL saturation as measured with gil_load ( https://github.com/chrisjbillington/gil_load ), but perhaps I should have included more numbers here. To me, seeing the…

Great point - dependencies between frames are inherently problematic for many of these techniques. Everything lostdog says. I've had experience speeding up tracking immensely using…