Earlier quoted context omitted.
no one wanted an iphone until it came out either
Everyone wanted something like an iphone and when it came it took over the market. We had a product that got shifted into a third world product overnight.
[deleted]
OpenAI and Apple Announce Partnership
151–160 of 343 posts
Re: OpenAI and Apple Announce Partnership
#152IMO this really feels like the Facebook / Twitter integration from early iOS. That only lasted a few years. Apple clearly thinks it needs a dedicated LLM service atm. But still thinks it is only supplemental as they handle a bunch of the core stuff without it. And require explicit user consent to use OpenAI. And Apple clearly views it as a partial commodity since they even said they plan to add others. Tough to bet a…
Disagree. This feels more like the Google partnership with Apple' Safari that has lasted for long time. Except in this case, I think is OpenAI who will get the big checks.
Apple doesn't even bother to highlight their cooperation with OpenAI. Instead they bury the integration of ChatGPT as the last section of their "Apple Intelligence" announcement: https://www.apple.com/newsroom/2024/06/introducing-apple-int...
Re: OpenAI and Apple Announce Partnership
#153~~This is not the direction I was hoping Apple would go with AI. With all the neural this and that bits baked into apple silicon, it has seemed [0] for a while that Apple wanted to run all these workloads locally, but this partnership seems like a significant privacy backslide. Another comment in this thread said something about they’re using b Apple silicon for these workloads, but didn’t give an indication of wheth…
Apple is in the position where it caters primarily to the tech ignorant, so coming out an explaining that Apple LLM is a bit worse (read: far worse) than the cool LLM's on the internet because they are privacy conscious is a non-starter. Local LLM's on regular local hardware (i.e. no $500+ dedicated GPUs) is way far behind SoTA models right now. Apple is not gonna be in a position where you can practically real-time…
(I haven’t watched the video yet)
I completely agree about the market positioning and not keeping up with other platforms’ abilities being a non-starter. I just hope it will be clear how to keep my external brain (phone) from being scanned by OpenAI.
(I don’t want it to seem like I’m just a hater of either Apple or OpenAI; I’m a more-recent adopter of Apple tech and I’m not looking back, and I have an OpenAI subscription and find it invaluable for some uses.)
Another thing I’m going to be looking for in the video is how this initiative jibes with the greenness Apple has been passing really hard. If they’re bringing this kind of generative AI from niches to every iphone, it seems that would add a fair amount of power consumption.
Re: OpenAI and Apple Announce Partnership
#154I'm confused now... Apple's other announcement today discussed on-device AI. So what sorts of queries will be on-device and what will be sent to OpenAI? How does this distinction appear in the UI?
I think the headlines are REALLY muddying things. From watching the Keynote, most of Apple Intelligence is their own stuff, mostly on-device. Siri explicitly asks you if you want to use chatGPT to answer a query. It does so when it thinks chatGPT will have a better answer. It sounds like that will be for very creative/generative types of things like "please create a 4 course meal with xyz foods," at which point Siri…
That said, the Apple Intelligence vs. OpenAI distinction seems much clearer than the Apple cloud vs. local distinction, which I find somewhat concerning.
Sure, the Apple cloud is ultra-secure and private and all, but I'd still like to know what happens where without having to test it myself by enabling airplane mode and seeing what still works.
Re: OpenAI and Apple Announce Partnership
#155Microsoft owns 49 percent of OpenAI.
That must be some really detailed 100+ pages contract.
I bet Microsoft is mentioned multiple times with things to the effect of: "Under no condition is Microsoft allowed to access any of the data coming from iPhones."
Re: OpenAI and Apple Announce Partnership
#156IMO this really feels like the Facebook / Twitter integration from early iOS. That only lasted a few years. Apple clearly thinks it needs a dedicated LLM service atm. But still thinks it is only supplemental as they handle a bunch of the core stuff without it. And require explicit user consent to use OpenAI. And Apple clearly views it as a partial commodity since they even said they plan to add others. Tough to bet a…
Actually, just in three to five years, lots of "AI boxes" and those magical sparkling icons next to input fields summoning AI would be silently removed. LLMs are not accurate, they aren't subject matter experts that'll be maybe within 5% error margin. People will gradually learn and discover anf the cost of keeping a model updated and running won't drastically reduce so we'll most likely see dust settling down.
LLMs are not accurate, they aren't subject matter experts that'll be maybe within 5% error margin.
You're asserting that the AI features will be removed in 3 to 5 years because they're not accurate enough today, but you actually need them to remain inaccurate in 3 years time for your prediction to be correct.
That seems unlikely. I agree that people will start to realize the cost, but the accuracy will improve, so people might be willing to pay.
Re: OpenAI and Apple Announce Partnership
#157Earlier quoted context omitted.
Not sure Nvidia is too happy with Apple. They are the first ones to ship on-device inference at scale on non-nvidia hardware. Apple also has the means to build data center training hardware using apple silicon if they want to do so. If they are serious about the OAI partnership they could also start to supply them with cloud inference hardware and strongarm them into only using apple servers to serve iOS requests.
> They are the first ones to ship on-device inference at scale on non-nvidia hardware Which is neat, but it's not CUDA. It's an application-specific accelerator good at a small subset of operations, controlled by a high-level library the industry is unfamiliar with and too underpowered to run LLMs or image generators. The NPU is a novelty, and today's presentation more-or-less confirmed how useless it is for rich loc…
> reinventing the wheel with an extra library/Accelerate Framework/MPS solution that nobody knows about and has to convert models to use.
This is Apple's favorite thing in the world. They already have an Apple-Silicon-only ML framework as of a few months ago, called MLX. Does anyone know about it? No. Do you need to convert models to use it? Yes.
Re: OpenAI and Apple Announce Partnership
#158Earlier quoted context omitted.
There’s a lot I don’t like about Sam Altman. There’s a lot I don’t like about OpenAI. But goddamn they absolutely leapfrogged Google and Apple and it’s completely amazing to see these trillion dollar companies play catch-up with a start-up. I want to see more of this. Big Tech has been holding back innovation for too long.
They "leapfrogged" Google on providing a natural language interface to the world knowledge we'd gotten used to retrieving throug web search. But Apple's never done more than toyed in that space. Apple's focus has long been on a lifestyle product experience across their portfolio of hardware, and Apple Intelligence appears to be focused exactly on that in a way that has little overlap with OpenAI's offerings. The part…
Siri is a toy, but I don't think that was Apple's intent. It's been a long-standing complaint that using Siri to search the web sucks compared to other companies offerings.
Re: OpenAI and Apple Announce Partnership
#159I'm confused now... Apple's other announcement today discussed on-device AI. So what sorts of queries will be on-device and what will be sent to OpenAI? How does this distinction appear in the UI?
When you ask Siri a question, it will prompt you to ask whether it can send your query/data to ChatGPT. All other AI features within the OS are powered by Apple's Private Compute Cloud, which is Apple's code running on Apple's chips at Apple's Data Center.
> All other AI features within the OS are powered by Apple's Private Compute Cloud
Clarification: All other AI features within the OS are powered by on device models which can reach out to the private cloud for larger workflows & models.
Re: OpenAI and Apple Announce Partnership
#160"Siri add an alarm for an appointment for the dentist tomorrow at 10" Sets appointment for 10pm Will the Siri team be fired or are they in charge of openAI integration?
Switching to 24-hour clock solves that problem.
Personally, 12h clock always confused me, so I wouldn't blame Siri.