Live data from Hacker News

Apple’s new Transformer-powered predictive text model

jackcook.com

91–100 of 268 posts

Re: Apple’s new Transformer-powered predictive text model

#91
post #50
post #40

Earlier quoted context omitted.

Typing on Android was perfect when Swype was still around. GBoard and SwiftKey were worse and seem to actually decline in accuracy till this day.

Swype was the best. Google should buy it and release it as the new version of Gboard

Swype was acquired by Nuance which was acquired by Microsoft. Its competitor, SwiftKey, was also acquired by Microsoft.

Re: Apple’s new Transformer-powered predictive text model

#92
post #70

The example output reads exactly like the existing output, I have had it get caught in exactly that cycle.

Even large language models with billions of parameters get caught in the cycle. You don't usually see it exposed to users because there are sampling tricks applied, such as repetition/frequency penalty.

Re: Apple’s new Transformer-powered predictive text model

#93
post #11
post #6

Earlier quoted context omitted.

I know it's infuriating but that's how marketing works, and since they are a successful company, idk why they would stop using it. Just like some people say "RTX" instead of RayTracing now, it's quite a success for the company if it managed to replace a technical term in the mind of most consumers

[flagged]

[deleted]

Re: Apple’s new Transformer-powered predictive text model

#94
post #55

Earlier quoted context omitted.

Modern language processing relies on pretty large corpora, and to bootstrap it requires a part to be of high quality and annotated, although for spelling correction you don't need annotation. Or you can go the GPT-3 route and use really huge corpora. If that doesn't exist for your language, and for many smaller languages it doesn't, it won't get better than 2007.

Indonesian is spoken by 200M people (45M of which as first language), I bet they could find some text for it. When joined with the Malaysian family, it brings the total speakers to 290M.

My understanding is that the languages with better support have the advantage of official bodies that have section-by-section translations of all their documents; the EU into its 24 official languages and the UN with its six, for starters.

Re: Apple’s new Transformer-powered predictive text model

#95
post #26

Meanwhile my language and dozens of others with hundreds of millions of speakers still don’t get the predictions at all, don’t support multi-language typing and don’t support swipe typing. Typing on a $1000 iPhone in one of these languages is still a 2007 experience.

My biggest multilingual gripe on iOS is that highlighting text in, say, Czech and pressing Translate on the popup just tells you to fuck off. Like, sure, don't support the language, but at least give me a Google Translate link then.

They do this for cycling directions in Apple Maps too.

Come on Apple, you KNOW you don’t support cycling directions in Ireland - stop getting my hopes up every time I ask for directions. Just only show the button when you’re in a geo that supports the feature.

Re: Apple’s new Transformer-powered predictive text model

#96
post #71
post #63

Earlier quoted context omitted.

Did you enable the Czech-English dictionary under Settings -> General -> Dictionary? You can also add Czech as a language under Settings -> General -> Language & Region -> Add Language. This will let you switch your keyboard to Czech when typing and enable the language on websites and stuff. You can also switch the whole phone to Czech if you like, just by moving Czech to the top of the list of preferred languages.

For comparison, by simply using Gboard in iPhone you don’t need that and can type English and Czech in the same keyboard.

Same with SwiftKey, if for any reason you'd rather not have your keyboard from GOOGL.

Re: Apple’s new Transformer-powered predictive text model

#97

Earlier quoted context omitted.

It already does and I hate it. If a person you’re speaking with misspells a word, it’ll happy suggest^w forcibly autocorrect a similar word to that misspelling if it was recent enough.

Do they do that across conversations, eg if I misspell something while texting you does it recommend my misspelling when you’re talking to other people?

Yes. Ever since I went to the Maldives it wants to capitalize "male" and I have to work quite hard to get it to not correct "Yes" to "Yea", and "Thailand" to "Thailnd". Hate it.

Re: Apple’s new Transformer-powered predictive text model

#99

For text input support, being boring feels like a feature not a bug. For writing on mobile, you'll be writing a lot of boring short messages. That's said, it'd be cool if it can precondition with the app name - You'll probably write something more interesting on Pages vs on iMessage.

[deleted]

Re: Apple’s new Transformer-powered predictive text model

#100
post #32

I don't want better predictive text. I need better autocorrect. Something happened about 6 years ago where the quality of the autocorrect fell off the roof, and it's been absolutely terrible since then. I spend too much of my time fighting with either mispelling, flipping to the wrong word even though I spelled the word properly, etc. It has made typing on my iPhone an unpleasant experience and I need it to change. T…

I've had a similar experience with autocorrect on Android across multiple phones (lg, samsung) and keyboards (gboard, swiftkey) around the same time, I'm curious to know whether it's just my own bias being validated or something happened. All predictions have become completely stupid (switching languages mid sentence when they were robust in the past, finding least consistent suggestion first, suggesting very random…

I can vouch for this from personal experience. Back when I had my Nexus 4, the built-in keyboard surpassed the current Gboard by a long shot. I'm not sure what happened along the way, but the spell-checking capabilities of the completely offline and lightweight keyboard that Google shipped back in those days were miles ahead.
Post reply on HN