Live data from Hacker News

Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

engadget.com

51–60 of 218 posts

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#51

> 472 gigaflops Whenever I hear a number of gigaflops or terraflops, I like to look up the history of super computers [0]. This $99 computer is faster (on paper) than the world's fastest supercomputer in 1996, or a bit over 20 years ago. That's pretty cool. [0] https://en.wikipedia.org/wiki/History_of_supercomputing#Mass...

A Pentium 90 was probably fairly common in the mid 90s. Delivered a whopping 0.09 GFLOPS :)

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#52
post #44
post #30

Cheaper than the $150 Google TPU Dev Board, and looks like it can do training as well as inference. Also, doesn't require you to send your model to their company. Nice!

Cheaper than the $150 Google TPU Dev Board, and looks like it can do training as well as inference. Training is a slight win (although it's going to be too slow for anything useful really). But it looks like the TPU will outperform this somewhat for inference. The 256 core Jetson (this has 128 cores) could run MobileNet-v2 at between 12 and 20 ms per image (depending on batch size)[1], while the USB TPU adapter takes…

>> Nor does the TPU dev board.

Yes it does require you to send your model to Google: https://coral.withgoogle.com/web-compiler/

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#53
post #30

Cheaper than the $150 Google TPU Dev Board, and looks like it can do training as well as inference. Also, doesn't require you to send your model to their company. Nice!

Quad core arm, 4gb of ram and gigE! Seems like a really nice board

Also has an M.2 slot for WiFi, as well as both HDMI and DP...supports two simultaneous displays out of the box.

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#54

> 472 gigaflops Whenever I hear a number of gigaflops or terraflops, I like to look up the history of super computers [0]. This $99 computer is faster (on paper) than the world's fastest supercomputer in 1996, or a bit over 20 years ago. That's pretty cool. [0] https://en.wikipedia.org/wiki/History_of_supercomputing#Mass...

Not quite. This is FP16, supercomputers are typically benchmarked using double precision flops, so FP64. So roll in a factor of ~4 there, or a couple of years.

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#55
post #47
post #44

Earlier quoted context omitted.

Cheaper than the $150 Google TPU Dev Board, and looks like it can do training as well as inference. Training is a slight win (although it's going to be too slow for anything useful really). But it looks like the TPU will outperform this somewhat for inference. The 256 core Jetson (this has 128 cores) could run MobileNet-v2 at between 12 and 20 ms per image (depending on batch size)[1], while the USB TPU adapter takes…

Seems to lose in Mobilenet and win in other benches according to Nvidia's benchmarks. I'll wait for independent testing before I drop $100. https://devblogs.nvidia.com/jetson-nano-ai-computing/

Horseshit in that bench right off the bat: I have a Google Edge TPU board right in front of me and its perf on SSD300 is 70fps, not 48. That's with the browser demo, which (as far as I can tell) includes realtime encoding of h264 for streaming. Almost twice as much as Jetson, and likely in a much more modest power envelope. NVIDIA is known for dishonesty in their benchmarks. Although TPU is, of course, a quantized play, and Maxwell will really suck for that, unless it's been tweaked specifically for this board.

OTOH, fp32 models are _much_ easier to work with, and this thing has more RAM so you can waste it on 32 bit weights, and NVIDIA's software toolkit is second to none. So the Jetson looks pretty tempting as well. I just wish they didn't try to insult my intelligence.

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#56
post #37
post #27

Earlier quoted context omitted.

This. And all of the third party camera solutions for TX2 cost $500+ when equivalent USB cameras with the same sensor cost $50. They really need to get their act together and sell some NVIDIA-sanctioned camera solutions at scale, and at price points similar to Raspberry Pi cameras. A lot of third party carrier boards also have a complete sh_tshow of connectors. Auvidea's boards, for example, ship with a Raspberry Pi…

They've actually fixed this hopefully this time around. According to their blog post it actually has driver support for the RPi CM2 8MP (IMX219) and they'll be releasing their own Nvidia-sanctioned cameras available from their partners. It should hopefully just work. No lowlight options at this time however, which means external CCTV is out of the question :(

Cool. Well hopefully some third parties will now create cameras all in the same form factor with the same pinout so that the choice of carrier board and camera can be independently made.

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#57
post #42
post #30

Cheaper than the $150 Google TPU Dev Board, and looks like it can do training as well as inference. Also, doesn't require you to send your model to their company. Nice!

there is no reason to train on that thing (except for zero shot classification demos). any cheap/lower end Nvidia gpu would do a much better job, and you would then transfer the model to the embedded thing.

Would it do better than a CPU for training? I do my dev on a MacBook Air and use AWS for training, if this cheap gpu will be a few times faster than my Air CPU than I’d be willing to get it. I usually work with medium sized models/data, too big for CPU but don’t need a multi gpu cluster.

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#59
post #57
post #42

Earlier quoted context omitted.

there is no reason to train on that thing (except for zero shot classification demos). any cheap/lower end Nvidia gpu would do a much better job, and you would then transfer the model to the embedded thing.

Would it do better than a CPU for training? I do my dev on a MacBook Air and use AWS for training, if this cheap gpu will be a few times faster than my Air CPU than I’d be willing to get it. I usually work with medium sized models/data, too big for CPU but don’t need a multi gpu cluster.

I would stick to AWS for training. Your CPU will be orders of magnitude slower than most GPUs for training.

Re: Nvidia's $99 Jetson Nano Is an AI Computer for DIY Enthusiasts

#60

I have a Jetson TX2, at the $99, I'm super tempted to buy one to see how it compares. That being said, I would definitely buy this if there is a way to make Plex server work with transcoding.

Wouldn't the Shield TV be a better fit in the same price range? It does Plex transcoding.
Post reply on HN