Live data from Hacker News

OpenAI is too cheap to beat

generatingconversation.substack.com

51–60 of 426 posts

Re: OpenAI is too cheap to beat

#51

[flagged]

"iamverysmart" comment.

Failing to embrace it will leave you behind. Consultants that use OpenAI’s GPT-4 language model are “significantly more productive and produced significantly higher quality results” than those who do not, according to a new study from the Harvard Business School: https://aibusiness.com/nlp/harvard-study-gpt-4-boosts-work-q...

Re: OpenAI is too cheap to beat

#52
post #46

I think OpenAI may eventually have to go upmarket, as basic "good enough" AI becomes increasingly viable and cheap/free on consumer level devices, supplied by FOSS models and apps. Apple may be leading the way here, with Apple Silicon prioritizing AI processing and built into all their devices. These capabilities are free (or at least don't require an extra sub), and just used to sell more hardware. OpenAI is clearly…

Where are you taking the confidence that Apple will be able to catch up to OpenAI’s GPT? “Apple's built-in AI capabilities” are very weak so far.

Not OP,

In my experience apple's ML on iphones is seamless. Tap and hold on your dog in a picture and it'll cut out the background, your photos are all sorted automatically including by person (and I think by pet).

OCR is seamless - you just select text in images as if it was real text.

I totally understand these aren't comparable to LLMs - rumor has it apple is working on an llm - if their execution is anything like their current ML execution it'll be glorious.

(Siri objectively sucks although I'm not sure it's fair to compare siri to an LLM as AFAIK siri does not do text prediction but is instead a traditional "manually crafted workflow" type of thing that just uses S2T to navigate)

Re: OpenAI is too cheap to beat

#53

I just paid the $20 for a month to try it out. In my super limited experience, GPT-4 is actually impressive and worth the money.

The value I get for that $20/month is astonishing. It's by far the best discretionary subscription I've ever had.

That scares me. I hate moats and actively want out. Running the uncensored 70B parameter Llama 2 model on my MacBook is great, but it's just not a competitive enough general intelligence to entirely substitute for GPT-4 yet. I think our community will get there, but the surrounding water is deepening, and I'm nervous...

Re: OpenAI is too cheap to beat

#54

I think OpenAI may eventually have to go upmarket, as basic "good enough" AI becomes increasingly viable and cheap/free on consumer level devices, supplied by FOSS models and apps. Apple may be leading the way here, with Apple Silicon prioritizing AI processing and built into all their devices. These capabilities are free (or at least don't require an extra sub), and just used to sell more hardware. OpenAI is clearly…

[deleted]

Re: OpenAI is too cheap to beat

#55
I think this is under appreciated. I run a "talk-to-your-files" website with 5ish K MRR and a pretty generous free tier. My OpenAI costs have not exceeded $200 / mo. People talk about using smaller, cheaper models but unless you have strong data security requirements you're burdening yourself with serious maintenance work and using objectively worse models to save pennies. This doesn't even consider OpenAI continuously lowering their prices.

I've talked to a good amount of businesses and 90% of custom use cases would also have negligible AI costs. In my opinion, unless you're in a super regulated industry or doing genuinely cutting edge stuff, you should probably just be using the best that's available (OpenAI).

Re: OpenAI is too cheap to beat

#56

I think OpenAI may eventually have to go upmarket, as basic "good enough" AI becomes increasingly viable and cheap/free on consumer level devices, supplied by FOSS models and apps. Apple may be leading the way here, with Apple Silicon prioritizing AI processing and built into all their devices. These capabilities are free (or at least don't require an extra sub), and just used to sell more hardware. OpenAI is clearly…

Please Apple let me replace worthless Siri with ChatGPT on my iPhone. Would completely change how I use the device.

Just yesterday, while driving: "Read last message."

Siri: "Sorry. Dictation service is unavailable at the moment."

It's past time for excuses. High-level people at Apple need to be fired over this. Hello? Tim? Do your job. Hello? Anybody home...?

Re: OpenAI is too cheap to beat

#57
post #46

I think OpenAI may eventually have to go upmarket, as basic "good enough" AI becomes increasingly viable and cheap/free on consumer level devices, supplied by FOSS models and apps. Apple may be leading the way here, with Apple Silicon prioritizing AI processing and built into all their devices. These capabilities are free (or at least don't require an extra sub), and just used to sell more hardware. OpenAI is clearly…

Where are you taking the confidence that Apple will be able to catch up to OpenAI’s GPT? “Apple's built-in AI capabilities” are very weak so far.

I'm not saying they will on the high-end, but maybe on the low end. Apple's strategy is to embed local AI in all their devices. Local AI will never be as capable as AI running in massive GPU datacenters, but if it can get to a point that it's "good enough" for most average users, that may be enough for Apple to undercut the low end of the market.

Re: OpenAI is too cheap to beat

#60
post #6
post #2

Didn't see batching taken into equation, might skew a bit

Yep, batching is a feature I really wish the OpenAI API had. That and the ability to intelligently cache frequently used prompts. Much easier to achieve this with a hosted OS model, so I guess it's a speed + customizability/cost tradeoff for the time being.

imo they dont have batching because they pack sequences before passing through the model. so a single sequence in a batch on OpenAI might have requests from multiple customers in it
Post reply on HN