OpenAI and Apple Announce Partnership

Post by nextaccountic » Mon, Jun 10, 2024, 11:47 PM UTC

wg0 wrote: post #277

onion2k wrote: post #156

Earlier quoted context omitted.

LLMs are not accurate, they aren't subject matter experts that'll be maybe within 5% error margin. You're asserting that the AI features will be removed in 3 to 5 years because they're not accurate enough today , but you actually need them to remain inaccurate in 3 years time for your prediction to be correct. That seems unlikely. I agree that people will start to realize the cost, but the accuracy will improve, so p…

Anyone claiming that accuracy of AI models WILL improve is either unaware of how they really work or is a snake oil salesman. Forget about a model that knows EVERYTHING. Let's just train a model that only is expert in not all the law of United states just one state and not even that, just understands FULLY the tax law of just one state to the extent that whatever documents you throw at it, it beats a tax consultancy…

Post by cyanydeez » Mon, Jun 10, 2024, 11:54 PM UTC

blueelephanttea wrote: post #24

IMO this really feels like the Facebook / Twitter integration from early iOS. That only lasted a few years. Apple clearly thinks it needs a dedicated LLM service atm. But still thinks it is only supplemental as they handle a bunch of the core stuff without it. And require explicit user consent to use OpenAI. And Apple clearly views it as a partial commodity since they even said they plan to add others. Tough to bet a…

Post by cyanydeez » Tue, Jun 11, 2024, 12:01 AM UTC

observationist wrote: post #280

A_D_E_P_T wrote: post #273

Earlier quoted context omitted.

I was with you until your last sentence. By all accounts Cook was one of the world's most effective managers of production and logistics -- a rare talent. He famously streamlined Apple's stock-keeping practices when he was a new hire at Apple. How much he exercises that talent in his day-to-day as CEO is not perfectly clear; it may perhaps have atrophied. In any case, "dime a dozen" doesn't do him justice -- he was v…

I look at it from a perspective of interchangeability - if you swapped Steve Ballmer in for Cook, nothing much would have changed. Same if you swapped Nadella in for Pichai, or Pichai for Cook. Very few of these men are exceptional; they are ordinary men with exceptional resources at hand. What they can do, what they should do, and what they can get away with, unseen, govern their impact. Leaders that actually impact…

Post by cyanydeez » Tue, Jun 11, 2024, 12:06 AM UTC

valine wrote: post #174

namaria wrote: post #133

Earlier quoted context omitted.

I don't believe this scenario to be very likely because a lot of the 'magic' in current LLMs (emphasis on 'large') is derived from the size of the training datasets and amount of compute they can throw at training and inference.

Llama 3 8B captures that 'magic' fairly well and runs on a modest gaming PC. You can even run it on an iPhone 15 if you're willing to sacrifice floating point precision. Three years from now I full expect GPT4 quality models running locally on an iPhone.

Post by 7speter » Tue, Jun 11, 2024, 12:37 AM UTC

talldayo wrote: post #285

bbatsell wrote: post #239

Earlier quoted context omitted.

They say user data remains in the Secure Enclave at all times, which Nvidia GPUs would not be able to access. I am quite certain that their private cloud inference runs only Apple silicon chips. (The pre-WWDC rumors were that they built custom clusters using M2 Ultras.)

Not that it matters anyways, since Apple refuses to sign Nvidia GPU drivers for MacOS in the first place. So if they own any Nvidia hardware themselves, then they also own more third-party hardware to support it.