Live data from Hacker News

Apple’s new Transformer-powered predictive text model

jackcook.com

11–20 of 268 posts

Re: Apple’s new Transformer-powered predictive text model

#11
post #6
post #4

[flagged]

I know it's infuriating but that's how marketing works, and since they are a successful company, idk why they would stop using it. Just like some people say "RTX" instead of RayTracing now, it's quite a success for the company if it managed to replace a technical term in the mind of most consumers

[flagged]

Re: Apple’s new Transformer-powered predictive text model

#12
post #4

[flagged]

> It's a small, fairly dumb LLM.

I have no idea whether you really don’t know what “LLM” stands for or are just trolling. Not calling it an LLM actually is more honest marketing precisely because it’s small, and “transformer-based model” is a precise technical description that everybody with even superficial knowledge of the field understood immediately.

And I’m actually onboard with most of your other examples. I’d include “all-day battery life” as another empty marketing term that doesn’t really say much.

Re: Apple’s new Transformer-powered predictive text model

#14
post #4

[flagged]

An LLM is a transformer model. That’s the standard, industry term. What are you going on about?

I am very aware of that.

Nowhere does the press release say LLM. That's because it's not very large or smart and when compared to most LLMs' "intellectual" performance, it looks bad. By avoiding that term, they are successfully sidestepping an important aspect of the evaluation of this system in the eyes of many Apple fans.

Re: Apple’s new Transformer-powered predictive text model

#15
post #12
post #4

[flagged]

> It's a small, fairly dumb LLM. I have no idea whether you really don’t know what “LLM” stands for or are just trolling. Not calling it an LLM actually is more honest marketing precisely because it’s small, and “transformer-based model” is a precise technical description that everybody with even superficial knowledge of the field understood immediately. And I’m actually onboard with most of your other examples. I’d…

I know that LLM stands for large language model. It is still that type of model even though that final parameter count is not very large. They are deliberately avoid "LLM" because it doesn't compare favorably with most.

Re: Apple’s new Transformer-powered predictive text model

#16
post #4

[flagged]

This is the one case where the technical term and Apple’s marketing actually do happen to overlap! These are transformer models. Apple didn't invent them, but their description of them is technically accurate. “LLM” is the dumbed-down term for the masses, describing only the “what” but not the “how”.

I know what a transformer model is. But Apple knows the normal technical term is LLM. They are deliberately avoiding it to try to create a new category for themselves, because their model's "intelligence" is very poor when compared to other LLMs.

Re: Apple’s new Transformer-powered predictive text model

#17
I don't want better predictive text. I need better autocorrect. Something happened about 6 years ago where the quality of the autocorrect fell off the roof, and it's been absolutely terrible since then. I spend too much of my time fighting with either mispelling, flipping to the wrong word even though I spelled the word properly, etc. It has made typing on my iPhone an unpleasant experience and I need it to change. That's just about the only thing better between the iPhone and Android for me.

Re: Apple’s new Transformer-powered predictive text model

#18

I don't want better predictive text. I need better autocorrect. Something happened about 6 years ago where the quality of the autocorrect fell off the roof, and it's been absolutely terrible since then. I spend too much of my time fighting with either mispelling, flipping to the wrong word even though I spelled the word properly, etc. It has made typing on my iPhone an unpleasant experience and I need it to change. T…

It's powered by the same thing. They even mention "Even more accurate autocorrect" in iOS 17 on the product page.

Re: Apple’s new Transformer-powered predictive text model

#19
post #15
post #12

Earlier quoted context omitted.

> It's a small, fairly dumb LLM. I have no idea whether you really don’t know what “LLM” stands for or are just trolling. Not calling it an LLM actually is more honest marketing precisely because it’s small, and “transformer-based model” is a precise technical description that everybody with even superficial knowledge of the field understood immediately. And I’m actually onboard with most of your other examples. I’d…

I know that LLM stands for large language model. It is still that type of model even though that final parameter count is not very large. They are deliberately avoid "LLM" because it doesn't compare favorably with most.

It’s an autocomplete model, it’s not designed to compare favorably to LLMs.

And a transformer model is a specific type of LLM. You could also build a language model using a RNN. There’s nothing deceptive here.

Re: Apple’s new Transformer-powered predictive text model

#20
UnilmCtrl seems to imply some dependence on Sochers CTRL models, but I wouldn't be surprised if it's just another name collision. Would be interesting if it were, as that would likely mean they have been working on releasing this for a few more years than the "chat-gpt craze". I am a bit biased, but I always have more respect if someone has worked in the NLP field for at least ~8 years, rather than jumping on after Sparrow and RLHF.
Post reply on HN