Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Edge AI for Beginners

github.com

Post reply on HN
Print view View original

21–30 of 67 posts

Re: Edge AI for Beginners

#21

Post by echelon »

btown wrote: post #8

It seems this is focused on on-device computation - as distinct from, say, Cloudflare's definition of the "edge" as a smart CDN with an ability to run arbitrary code and AI models in geographically distributed data centers ( https://workers.cloudflare.com/ ). Per Microsoft's definition in https://github.com/microsoft/edgeai-for-beginners/blob/main/... : > EdgeAI represents a paradigm shift in artificial intelligence…

In GPU compute land, "edge" means on the consumer device. The latency of delivery is negligible in comparison to the wall clock compute demands, so it doesn't make much sense to park your GPUs near the consumer.

IoT is "edge".

The only place I've seen "edge" used otherwise is in delivery of large files, e.g. ISP-colocated video delivery.

Re: Edge AI for Beginners

#22

Post by davnicwil »

btown wrote: post #8

It seems this is focused on on-device computation - as distinct from, say, Cloudflare's definition of the "edge" as a smart CDN with an ability to run arbitrary code and AI models in geographically distributed data centers ( https://workers.cloudflare.com/ ). Per Microsoft's definition in https://github.com/microsoft/edgeai-for-beginners/blob/main/... : > EdgeAI represents a paradigm shift in artificial intelligence…

maybe a decent definition could be compute as close to the user latency-wise as practically possible while having full access to the necessary data.

For certain things this will be able to go as far as the device if you're only ever operating on data the user fully owns, other things will need data centers still but just decentralised and closer to the user via fancier architectures ala the Cloudflare model.

Re: Edge AI for Beginners

#23

Post by vlovich123 »

pclmulqdq wrote: post #9
btown wrote: post #8

It seems this is focused on on-device computation - as distinct from, say, Cloudflare's definition of the "edge" as a smart CDN with an ability to run arbitrary code and AI models in geographically distributed data centers ( https://workers.cloudflare.com/ ). Per Microsoft's definition in https://github.com/microsoft/edgeai-for-beginners/blob/main/... : > EdgeAI represents a paradigm shift in artificial intelligence…

Yeah, Cloudflare is in the minority with their definition of "edge."

No, edge is just poorly defined. Plenty of companies call their servers “edge” because they’re collocated with ISPs. Even ISPs when they talk about edge compute aren’t talking about your laptop but about compute in their colo.

Re: Edge AI for Beginners

#25

Post by flexagoon »

gl-prod wrote: post #10

It's funny that they used AI to translate into other languages, because the Arabic cover image is just gibberish.

In Russian, the cover image says "Al" (with an L) instead of AI, and on the little CPU icon in the corner "AI" just got replaced with "A".

Edit: seems like it's like that in most languages lol, at least those with a latin script

Re: Edge AI for Beginners

#26

Post by gl-prod »

flexagoon wrote: post #25
gl-prod wrote: post #10

It's funny that they used AI to translate into other languages, because the Arabic cover image is just gibberish.

In Russian, the cover image says "Al" (with an L) instead of AI, and on the little CPU icon in the corner "AI" just got replaced with "A". Edit: seems like it's like that in most languages lol, at least those with a latin script

It looks like a box with new text inserted over the original image

Re: Edge AI for Beginners

#27

Post by globalnode »

btown wrote: post #8

It seems this is focused on on-device computation - as distinct from, say, Cloudflare's definition of the "edge" as a smart CDN with an ability to run arbitrary code and AI models in geographically distributed data centers ( https://workers.cloudflare.com/ ). Per Microsoft's definition in https://github.com/microsoft/edgeai-for-beginners/blob/main/... : > EdgeAI represents a paradigm shift in artificial intelligence…

micro-edge?, medge, wedge, xedge...

Re: Edge AI for Beginners

#29

Post by thenthenthen »

gl-prod wrote: post #10

It's funny that they used AI to translate into other languages, because the Arabic cover image is just gibberish.

Oh this is hilarious, it is like they used Google Lens like method of translating (overlay the translation, you can see the text blocks). In the Dutch one, the cpu AI text just reads: ‘een’ aka ‘a’ in English

Re: Edge AI for Beginners

#30

Post by Legend2440 »

doctoboggan wrote: post #13

The very first sentence: > Welcome to EdgeAI for Beginners – your comprehensive... Em dash and the word "comprehensive", nearly 100% proof the document was written by AI. I use AI daily for my job, so I am not against its use, but recently if I detect some prose is written by AI it's hard for me to finish it. The written word is supposed to be a window into someone's thoughts, and it feels almost like a broken social…

I don’t really care if it was.

It’s also documentation for an AI product, so I’d kinda expect them to be eating their own dogfood here.

Post reply on HN