Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Transformer architecture optimized for Apple Silicon

github.com

Post reply on HN
Print view View original

251–260 of 342 posts

Re: Transformer architecture optimized for Apple Silicon

#251

Post by FredPret »

post-it wrote: post #221
parker_mountain wrote: post #88

Earlier quoted context omitted.

> how garbage Siri quality is today a few notes on this - siri is incredibly underinvested. They have another team that's building some sort of search and natural language processing engine, that has slowly sapped away some key headcount from the siri team. - apple doesn't get the full advantage of tons of user data from the wild. this is both a bug and a feature - the siri api model is clearly generations old, and i…

It's probably not glasses. Nobody likes wearing glasses. Every attempt at making tech glasses has failed. It'll probably be the Apple Watch.

Everybody would love wearing Apple Glasses. Would probably look really cool.

I remember seeing AirPods in somebody's ears for the first time. "What a dork" I thought back then. Now they're cool and everywhere.

Re: Transformer architecture optimized for Apple Silicon

#252

Post by dragonwriter »

jazzyjackson wrote: post #115
itg wrote: post #82

Earlier quoted context omitted.

I would not say they are the best chips if you want to run locally. They are ok although a bit slow compared to desktop gpus for inference.

What desktop GPUs would you recommend for the home user with access to 20+ GB of VRAM? I can get a Mac Studio with 128GB of shared RAM for about 5k.

> What desktop GPUs would you recommend for the home user with access to 20+ GB of VRAM?

I think the usual current model would be the 24GB Nvidia RTX 4090.

Re: Transformer architecture optimized for Apple Silicon

#253

Post by random_kris »

endisneigh wrote: post #7

i'd say within 5 years apple will have optimized apple silicon and their tech, along with language model improvements, such that you will be able to get gpt-4 level performance in the iPhone 19 with inference happening entirely locally. openai is doing great work and is serious competition, but I think many underestimate big tech. once they're properly motivated they'll catch up quick. I think we can agree that opena…

5 years ? I'd say 1 or 2. Or this September already judging by the rate of change recently

Re: Transformer architecture optimized for Apple Silicon

#254

Post by pfoof »

leodriesch wrote: post #246
pfoof wrote: post #237

So, is Stable Diffusion working finally on TPU or not? DiffusionBee uses GPU and running this https://github.com/apple/ml-stable-diffusion with CPU_AND_NE just segfaults

Amazing AI by Sindre Sorhus uses Apples port of Stable Diffusion to the neural engine. https://sindresorhus.com/amazing-ai

Thanks, will check that out!

Re: Transformer architecture optimized for Apple Silicon

#255

Post by highwaylights »

FredPret wrote: post #251
post-it wrote: post #221

Earlier quoted context omitted.

It's probably not glasses. Nobody likes wearing glasses. Every attempt at making tech glasses has failed. It'll probably be the Apple Watch.

Everybody would love wearing Apple Glasses. Would probably look really cool. I remember seeing AirPods in somebody's ears for the first time. "What a dork" I thought back then. Now they're cool and everywhere.

> Now they're cool and everywhere.

One of these things is true.

Re: Transformer architecture optimized for Apple Silicon

#256

Post by highwaylights »

lotsofpulp wrote: post #83
threeseed wrote: post #78

Earlier quoted context omitted.

They do have a search engine though with Siri Suggestions. Which has a user base of ~1.5b+ people. We only see the tip of the iceberg so who knows what else it is capable of.

“Hey siri, what is today’s date?” “Sorry, I’m having trouble connecting to the network”

two minutes later

"Hey Siri, what is today's date?"

"That's sweet, but I think of you as a friend"

"What? The date, Siri, what is the date?"

"You're so sweet"

"Sigh"

Re: Transformer architecture optimized for Apple Silicon

#257

Post by highwaylights »

lotsofpulp wrote: post #179
fingerlocks wrote: post #177

Earlier quoted context omitted.

Just tried this exact interaction. Siri gave me a list of nearest Toyotas and made the call. Seems to be working just fine. Starting to think all these Siri complaints are either made up or really outdated.

I only use Siri with the original Homepods. It has always been terrible. You cannot even tell it to start playing movies on the TV that you have already purchased from Apple itself in the TV app. It will start to play some random song or something. I should be able to say hey siri, start playing on , and it should be able to start the TV and start playing it.

A friend has one that constantly plays U2 out of nowhere. He doesn't even listen to U2, and maintains that he's never requested it.

This isn't in response to a prompt either. He'll unpause the connected TV and it'll just start blasting U2.

Re: Transformer architecture optimized for Apple Silicon

#258

Post by nicky0 »

fingerlocks wrote: post #177
epistasis wrote: post #130

Earlier quoted context omitted.

Me: Hey Siri, call Toyota. Siri: I'm sorry, that contact is not in your list Me: Siri, what is the number for Toyota. Siri: Toyota's phone number is 123-456-7890 [said too fast to remember or write down in one go] Me: Siri, call Toyota Siri: I'm sorry, you do not have that contact number. Me: &$@@&/&&/&!!!

Just tried this exact interaction. Siri gave me a list of nearest Toyotas and made the call. Seems to be working just fine. Starting to think all these Siri complaints are either made up or really outdated.

You must be the one user that Siri works perfectly for.

Re: Transformer architecture optimized for Apple Silicon

#259

Post by nicky0 »

scarface74 wrote: post #96
dmd wrote: post #85

Earlier quoted context omitted.

“hey siri, what’s the weather today?” “Now playing Eminem Love the way you lie featuring Rihanna”

And that has nothing to do with an LLM. That has to do with speech to text algorithms. It also doesn’t take advanced AI to do a simple intents based answers.

Yes we are aware that Siri doesn't use LLM yet. That is what this thread is about.

Re: Transformer architecture optimized for Apple Silicon

#260

Post by janekm »

parker_mountain wrote: post #153
afavour wrote: post #99

Earlier quoted context omitted.

“Yes Siri is garbage but it doesn’t matter because Apple are probably working on a top secret new thing that will blow everyone else out of the water” You might be right but there’s no real evidence for it yet.

>because Apple are probably working on a top secret new thing that will blow everyone else out of the water” that's a mischaracterization of what i said. what i said was that they have been clearly hiring key positions and cannibalizing the siri team for something new. that something new will likely be a major release. i also believe that the ar headset is the unifying product under which they're rallying.

You may well be right, but if so that's a huge problem for Apple as by all accounts the AR device is still many years from being ready for release and meanwhile they are in a very precarious situation with Siri...

The first proper integration of a Whisper & a GPT-class LM will be a big step change, a Siri-like AI that you can actually talk to somewhat sensibly and expect it to "understand" more than pre-set phrases... Google could be in a position to release something for Android, and their are Android SoCs with neural accelerators as well (sure nothing as impressive as Apple's chips but Samsung have demonstrated a cut-down SD model on their SoC).

Post reply on HN