Inference times for inception-v3 on a Raspberry Pi have been benchmarked recently [1]. They weigh in at around 2s. If you remove the python layer it gets down to 500ms. However, it's not yet clear if the python overhead is the only reason for that. Nvidia's Tegra X1 should supposedly be capable of And finally, Sam who also facilitated building TF on the Pi is about to host a 6 weeks half theory, half practice course…
Hey Alex, thanks for the comment! Have you tried out image classification with the Tegra X1 yourself by chance??
I haven't but the ressources on jetsonhacks.com are amazing to see robot vision on this board in action.