This is far from what I expected. There is not much related to quantization, pruning, common architectures, precision or benchmarking. For those interested in this topic, I would recommend content from MIT HAN Lab.
Edge AI for Beginners
31–40 of 67 posts
Re: Edge AI for Beginners
#32Earlier quoted context omitted.
Yeah, Cloudflare is in the minority with their definition of "edge."
No, edge is just poorly defined. Plenty of companies call their servers “edge” because they’re collocated with ISPs. Even ISPs when they talk about edge compute aren’t talking about your laptop but about compute in their colo.
edge just means as close to the user as you can get.
microsoft's edge is closer to the user than cloudflare's edge or an ISP's edge because microsoft runs your laptop.
Re: Edge AI for Beginners
#33The very first sentence: > Welcome to EdgeAI for Beginners – your comprehensive... Em dash and the word "comprehensive", nearly 100% proof the document was written by AI. I use AI daily for my job, so I am not against its use, but recently if I detect some prose is written by AI it's hard for me to finish it. The written word is supposed to be a window into someone's thoughts, and it feels almost like a broken social…
You forget that MS Word loves to substitute things like em dashes in where you don’t want them. The “auto correct” to those directional quotation marks that every compiler barfs on used to be a real peeve with I was forced to use MS junk.
Re: Edge AI for Beginners
#34This was made by AI
Re: Edge AI for Beginners
#35It's funny that they used AI to translate into other languages, because the Arabic cover image is just gibberish.
Interestingly the French is completely different.
https://github.com/microsoft/edgeai-for-beginners/blob/main/...
Re: Edge AI for Beginners
#36What are the best Small Language Models (SLMs) these days?
Best is very subjective depends what you want it to do and if you want to fine tune and how big you consider small
Re: Edge AI for Beginners
#37The very first sentence: > Welcome to EdgeAI for Beginners – your comprehensive... Em dash and the word "comprehensive", nearly 100% proof the document was written by AI. I use AI daily for my job, so I am not against its use, but recently if I detect some prose is written by AI it's hard for me to finish it. The written word is supposed to be a window into someone's thoughts, and it feels almost like a broken social…
> AI generated prose should be labeled as such, it's the decent thing to do.
The decent thing to do is to prefix the slop with the prompt, so humans don't waste their time reading it.
Re: Edge AI for Beginners
#38Earlier quoted context omitted.
No, edge is just poorly defined. Plenty of companies call their servers “edge” because they’re collocated with ISPs. Even ISPs when they talk about edge compute aren’t talking about your laptop but about compute in their colo.
edge just means as close to the user as you can get. microsoft's edge is closer to the user than cloudflare's edge or an ISP's edge because microsoft runs your laptop.
Wow, they really do have an edge over the competition there...
Re: Edge AI for Beginners
#39Earlier quoted context omitted.
Or just by somebody that knows how to use English punctuation properly. Is it so hard to believe that there are some people in the world capable of hitting option + “-“ on their keyboard (or simply let their editor do it for them)?
I said em dash _and_ the word comprehensive. If you work with LLM generated text enough it gets very easy to see the telltale signs. The emojis at the start of each row in the table are also a dead giveaway. I am guessing you are one of those people who used em dashes before LLMs came out and are now bitter they are an indicator of LLMs. If that's the case, I am sorry for the situation you find yourself in.
> The emojis at the start of each row in the table are also a dead giveaway.
What's up with the green checks, red Xs, rockets, and other stupid emoji in AI slop? Is it an artifact from the cheapest place to do RLHF?
Re: Edge AI for Beginners
#40It seems this is focused on on-device computation - as distinct from, say, Cloudflare's definition of the "edge" as a smart CDN with an ability to run arbitrary code and AI models in geographically distributed data centers ( https://workers.cloudflare.com/ ). Per Microsoft's definition in https://github.com/microsoft/edgeai-for-beginners/blob/main/... : > EdgeAI represents a paradigm shift in artificial intelligence…
I work at an industrial plant, we use "edge" to refer to something inside the production network.
As an example the control system network is air-gapped so to use ML for instrument control or similar the model needs to run on some type of "edge" compute device inside the production network all of the inferencing would need to happen locally (i.e. not in the cloud).