Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Edge AI for Beginners

github.com

Post reply on HN
Print view View original

51–60 of 67 posts

Re: Edge AI for Beginners

#51

Post by lxgr »

schrodinger wrote: post #44
accoil wrote: post #18

Earlier quoted context omitted.

If it makes a difference: it's an en dash used in the readme. I've been wondering why LLMs seem to prefer the em dash over en dash as I feel like en (or hyphen) is used more frequently in modern text.

In my experience the em dash is still correctly used, the modern style has just evolved to put a space around it. So: * fragment a—fragment b (em dash, no space) = traditional * fragment a — fragment B (em dash with spaces) = modern * fragment a -- fragment b (two hyphens) = acceptable sub when you can’t get a proper em to render But en-dashes are for numeric ranges…

em dash plus spaces is quite rare in English style guides. It’s usually either an em dash and no spaces or an en dash with them.

Re: Edge AI for Beginners

#52

Post by lxgr »

doctoboggan wrote: post #16
lxgr wrote: post #15

Earlier quoted context omitted.

Or just by somebody that knows how to use English punctuation properly. Is it so hard to believe that there are some people in the world capable of hitting option + “-“ on their keyboard (or simply let their editor do it for them)?

I said em dash _and_ the word comprehensive. If you work with LLM generated text enough it gets very easy to see the telltale signs. The emojis at the start of each row in the table are also a dead giveaway. I am guessing you are one of those people who used em dashes before LLMs came out and are now bitter they are an indicator of LLMs. If that's the case, I am sorry for the situation you find yourself in.

Yes, it’s become a tired trope of a particular kind of LLM luddite to me.

Especially given that there are so many linguistic tics one could pick on instead! “Not x, but y”, the bullseye emoji etc., but instead they get hung up on a typographic character actually widely used, presumably because they assume it only occurs on professionals’ keyboards and nobody would take enough care to use it in casual contexts.

Re: Edge AI for Beginners

#53

Post by discordance »

geraldwhen wrote: post #7
fishmicrowaver wrote: post #6

MS GitHub seems to be featuring a lot of beginners courses all at the same time. Wonder if they're just pumping them out with AI at this point.

Seems to be. There’s little chance this was written by a human.

You may be underestimating how many people work at Microsoft on documentation and course related material.

Re: Edge AI for Beginners

#54

Post by ArcHound »

username223 wrote: post #39
doctoboggan wrote: post #16

Earlier quoted context omitted.

I said em dash _and_ the word comprehensive. If you work with LLM generated text enough it gets very easy to see the telltale signs. The emojis at the start of each row in the table are also a dead giveaway. I am guessing you are one of those people who used em dashes before LLMs came out and are now bitter they are an indicator of LLMs. If that's the case, I am sorry for the situation you find yourself in.

> The emojis at the start of each row in the table are also a dead giveaway. What's up with the green checks, red Xs, rockets, and other stupid emoji in AI slop? Is it an artifact from the cheapest place to do RLHF?

It's the linkedin post recommendation AFAIK. The LI algo pushed such posts to the top before. So my leap of thought is that somebody at MS decided that top LI posts is the go-to structure for "good text".

I have no proof, sorry.

Re: Edge AI for Beginners

#55

Post by ArcHound »

jerpint wrote: post #36
iJohnDoe wrote: post #14

What are the best Small Language Models (SLMs) these days?

Best is very subjective depends what you want it to do and if you want to fine tune and how big you consider small

Let me ask the same with: - runs on a laptop CPU - decide if a long article is relevant to a specified topic. Maybe even a summary of the article or picking the interesting part as specified in prompt instructions. - no fine tuning please.

Thank you for any response!

Re: Edge AI for Beginners

#56

Post by netfortius »

I remember when we bought and installed, among the first in the world, the AWS Outpost, sold as an "edge" (of in between cloud and on prem) infrastructure product. Same term has been previously (ab)used also in the security space, at - again - the confluence between cloud and on-prem. And then - yet one more time - the "edge" was a closer data center for localized delivered cloud services.

Re: Edge AI for Beginners

#57

Post by porridgeraisin »

I would say this is a poor beginners guide for quantization/compression, it's mostly an API guide for tf/keras quantization APIs it doesn't tell the beginner why or when or which layers (and why) they should apply it to.

But the modules that compare the different model families are quite good. As are the remaining modules that are "How to deploy to $platform 101", including microsoft's, of course ;)

Not that I have a better resource at hand for quantization/compression _for beginners_, and I am probably a bad judge for how beginner friendly Song Han's TinyML course was...

Re: Edge AI for Beginners

#58

Post by mapleoin »

This looks like AI slop to me. The first two modules repeat the benefits of Edge AI five times. The "Practical Implementation Guide" https://github.com/microsoft/edgeai-for-beginners/blob/main/... ends with a Pre-course checklist. The whole article is just mini-examples without enough context to understand anything.
Post reply on HN