211–220 of 342 posts
Earlier quoted context omitted.
I'm not so sure. When is the last time apple came out something groundbreaking? Has there been anything since Tim Cook took over? Siri is still extremely basic and barely usable for anything besides starting a kitchen timer.
> I'm not so sure. When is the last time apple came out something groundbreaking? M1 chips?
Earlier quoted context omitted.
They have every query their users enter into Spotlight. They have all the results it returns (who cares if they originated from Google, ok maybe they do, maybe not using it for anything is part of their deal with Google). They have your contacts, calendars, messages, email, music, workout history, tasks, real time location, which Siri already uses to e.g. recommend a destination when you get in your car to a degree o…
Apple does not have the queries that their users enter into spotlight, They dont have all the results it returns. You dont spawn a network request on every local search on an apple device.
As a newbie to this space, I see this mentioning PyTorch. I was looking at Whisper earlier today and, somewhat impressively, was reminded that my M1 Pro has a CPU fan. Is it realistic to think it would be a modest amount of work to install this in my local venv and use the NPU instead?
Earlier quoted context omitted.
I would not say they are the best chips if you want to run locally. They are ok although a bit slow compared to desktop gpus for inference.
What desktop GPUs would you recommend for the home user with access to 20+ GB of VRAM? I can get a Mac Studio with 128GB of shared RAM for about 5k.
Earlier quoted context omitted.
I was just setting reminders today and had Siri repeatedly fail to do what I want. The only use case I have for it is setting timers, which is does very well. I'd use it for much more if it was as good as ChatGPT.
This is entirely my point. They’re all crap at a fundamental level, none of them outperform any other. But the next generation, which will assuredly be backed by a LLM, will be shockingly powerful.
The bottleneck with compute at the edge is (and will be) model size (both app download time and storage space on device). Stable Diffusion sits at about 2GB for fp16, Whisper Medium at 1.53GB, LLAMA is 120GB. Sure, Apple can ship an optimized model ( 1GB.
Earlier quoted context omitted.
> I'm not so sure. When is the last time apple came out something groundbreaking? M1 chips?
An ARM cpu is groundbreaking? I don't think anyone outside the tech world has even noticed.
i'd say within 5 years apple will have optimized apple silicon and their tech, along with language model improvements, such that you will be able to get gpt-4 level performance in the iPhone 19 with inference happening entirely locally. openai is doing great work and is serious competition, but I think many underestimate big tech. once they're properly motivated they'll catch up quick. I think we can agree that opena…
i'd say within 5 years apple will have optimized apple silicon and their tech, along with language model improvements, such that you will be able to get gpt-4 level performance in the iPhone 19 with inference happening entirely locally. openai is doing great work and is serious competition, but I think many underestimate big tech. once they're properly motivated they'll catch up quick. I think we can agree that opena…