Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI and Apple Announce Partnership

openai.com

Post reply on HN
Print view View original

261–270 of 343 posts

Re: OpenAI and Apple Announce Partnership

#261

Post by refulgentis »

TeMPOraL wrote: post #258
valine wrote: post #174

Earlier quoted context omitted.

Llama 3 8B captures that 'magic' fairly well and runs on a modest gaming PC. You can even run it on an iPhone 15 if you're willing to sacrifice floating point precision. Three years from now I full expect GPT4 quality models running locally on an iPhone.

Three years is more than twice the time since GPT-4 was released to now. Almost twice the time ChatGPT existed. At this rate, even if we'll end up with GPT-4 equivalents runnable on consumer hardware, the top models made available by big players via API will make local LLMs feel useless. For the time being, the incentive to use a service will continue. It's like a graphics designer being limited to chose between loca…

They're extremely pessimistic, 3 years is 200% of how long it took ChatGPT 3.5.

Llama 8B is ChatGPT 3.5 (18 months before L3), running on all new iPhones released since October 2022, (19 months before L3). That includes multimodal variants (built outside Facebook).

Re: OpenAI and Apple Announce Partnership

#262

Post by TeMPOraL »

wg0 wrote: post #52
blueelephanttea wrote: post #24

IMO this really feels like the Facebook / Twitter integration from early iOS. That only lasted a few years. Apple clearly thinks it needs a dedicated LLM service atm. But still thinks it is only supplemental as they handle a bunch of the core stuff without it. And require explicit user consent to use OpenAI. And Apple clearly views it as a partial commodity since they even said they plan to add others. Tough to bet a…

Actually, just in three to five years, lots of "AI boxes" and those magical sparkling icons next to input fields summoning AI would be silently removed. LLMs are not accurate, they aren't subject matter experts that'll be maybe within 5% error margin. People will gradually learn and discover anf the cost of keeping a model updated and running won't drastically reduce so we'll most likely see dust settling down.

> People will gradually learn and discover anf the cost of keeping a model updated and running won't drastically reduce so we'll most likely see dust settling down.

As mentioned elsewhere, 3 to 5 years is some 3x to 5x as long as GPT-4 exists; some 2-3x as long as ChatGPT exists and LLMs suddenly graduated from being obscure research projects to general-purpose tools. Do you really believe the capability limit has already been hit?

Not to mention, there's lots of money and reputation invested in searching for alternatives to current transformer architecture. Are you certain that within the next year or two, one or more of the alternatives won't pan out, bringing e.g. linear scaling in place of quadratic, without loss of capabilities?

Re: OpenAI and Apple Announce Partnership

#263

Post by akira2501 »

zug_zug wrote: post #54

This sounds like exactly what I wanted. There have been a number of times I've been in the car and wanting to ask Siri something it couldn't handle has been a lot e.g. "What state am I in, and how far am I to the border to the state I'm going to cross next, and can I pump my own gas on each state I'm driving through?" Though a bit of that is premised on whether it could extract information from google maps.

> "What state am I in, and how far am I to the border to the state I'm going to cross next, and can I pump my own gas on each state I'm driving through?"

What kind of trip was this where these were pertinent questions? Couldn't you have just rephrased most of them?

"What is my current location?"

"Show maps."

"Which states don't allow you to pump your own gas?"

Re: OpenAI and Apple Announce Partnership

#266

Post by kolinko »

blibble wrote: post #241
ec109685 wrote: post #225

Earlier quoted context omitted.

Companies really don’t like being sued for hundreds of millions in punitive damages just for the benefit of training on the small percentage of people that opt out.

it's "fair use" mate

no it isn’t

Re: OpenAI and Apple Announce Partnership

#267

Post by valine »

TeMPOraL wrote: post #258
valine wrote: post #174

Earlier quoted context omitted.

Llama 3 8B captures that 'magic' fairly well and runs on a modest gaming PC. You can even run it on an iPhone 15 if you're willing to sacrifice floating point precision. Three years from now I full expect GPT4 quality models running locally on an iPhone.

Three years is more than twice the time since GPT-4 was released to now. Almost twice the time ChatGPT existed. At this rate, even if we'll end up with GPT-4 equivalents runnable on consumer hardware, the top models made available by big players via API will make local LLMs feel useless. For the time being, the incentive to use a service will continue. It's like a graphics designer being limited to chose between loca…

No one knows how it will all shake out. I'm personally skeptical scaling laws will hold beyond GPT4 sized models. GPT4 is likely severely undertrained given how much data facebook is using to train their 8B parameter models. Unless OpenAI has a dramatic new algorithmic discovery or a vast trove of previously unused data, I think GPT5 and beyond will be modest improvements.

Alternatively synthetic data might drive the next generation of models, but that's largely untested at this point.

Re: OpenAI and Apple Announce Partnership

#268

Post by akira2501 »

solarkraft wrote: post #234

OpenAI is such a controversial company and good competitors like Anthropic, who arguably align better with their brand, exist. That makes the deal so weird to me.

OpenAI has nothing of particularly high value. They're giving away the store right now just to claim the onboarding. This unsustainable game will end badly and soon.

Re: OpenAI and Apple Announce Partnership

#269

Post by TeMPOraL »

getpost wrote: post #200

GPT4o access is a handy feature, but, what I was hoping to hear about is an improvement in Siri's language "understanding." In today's WWDC presentation, there were a few small examples of Siri improvements, such as an ability to maintain context, e.g., 'Add her flight arrival time to my calendar,' wherein Siri knows who "her" refers to. In my day-to-day experience with Siri, it's clear Siri doesn't have the kind of…

That's something that I keep wondering about. The existing voice assistants are all garbage across the board. Whatever you say about Siri, Google's assistant is even worse. Meanwhile, for the past couple months, I was able to fire up ChatGPT app and speak to it casually, in noisy environments, and it would both correctly convert my speech to text (with less than 5% errors) and correctly understand what I'm actually saying (even in presence of transcription errors).

All it takes to make a qualitatively better voice assistant would be to give GPT-4 a spec of functions representing things it can do on your phone, and integrating that with the OS. So why none of the companies bothered to do it? For that matter, I wonder why OpenAI didn't extend the ChatGPT app in this direction?

Re: OpenAI and Apple Announce Partnership

#270

Post by whimsicalism »

kolinko wrote: post #256
whimsicalism wrote: post #79

Earlier quoted context omitted.

they're going to be using nvidia (or maybe AMD if they ever catch up) to train these models anyways

not necessarily so, in terms of tflops per $ (of apple’s cost of gpus, nit consumer), and tflops per watt their apple silicon is comparable if not better

flops/$ is simply not all (or even most) that matters when it comes to training LLMs.... Apple releases LLM research - all of their models are trained on nvidia.
Post reply on HN