Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI is too cheap to beat

generatingconversation.substack.com

Post reply on HN
Print view View original

41–50 of 426 posts

Re: OpenAI is too cheap to beat

#43

Post by SkyMarshal »

BudaDude wrote: post #33
grahamplace wrote: post #28

Earlier quoted context omitted.

> OpenAI is clearly going to compete in that market with its upcoming phone What phone are you referring to? A quick google didn’t seem to pull up anything related to OpenAI launching a hardware product?

They are most likely referring to this in collaboration with Jony Ive: https://www.yahoo.com/entertainment/openai-jony-ive-talks-ra...

Yes that one.

Re: OpenAI is too cheap to beat

#45

Post by Havoc »

Yep. Building a project that needs some LLMs. I'm very much of the self-hosting mindset so will try DIY, but it's very obviously the wrong choice by any reasonable metric.

OpenAI will murder my solution by quality, by availability, by reliability and by scalability...all for the price of a coffee.

It's a personal project though & partly intended for learning purposes so there is scope for accepting trainwreck level tradeoffs.

No idea how commercial projects are justifying this though.

Re: OpenAI is too cheap to beat

#46

Post by layer8 »

SkyMarshal wrote: post #15

I think OpenAI may eventually have to go upmarket, as basic "good enough" AI becomes increasingly viable and cheap/free on consumer level devices, supplied by FOSS models and apps. Apple may be leading the way here, with Apple Silicon prioritizing AI processing and built into all their devices. These capabilities are free (or at least don't require an extra sub), and just used to sell more hardware. OpenAI is clearly…

Where are you taking the confidence that Apple will be able to catch up to OpenAI’s GPT? “Apple's built-in AI capabilities” are very weak so far.

Re: OpenAI is too cheap to beat

#47

Post by fulafel »

This focuses on compute capacity but wouldn't the algorithmic improvements be much more important in bang for the buck at this stage as there's so much low hanging fruit as evidenced by constant stream of news about getting better results with less hardware.

Re: OpenAI is too cheap to beat

#48

Post by joefourier »

daft_pink wrote: post #7

I’m confused don’t a100s cost 10,000 to buy? Why would you pay 166k per year to rent?

AWS is extremely overpriced for nearly every service. I don’t know why anyone else outside of startups with VC money to burn or bigcos that need the “no one ever got fired for buying IBM” guarantee would use them. You’re better off with Lambdalabs or others which charge only $1.1/h per A100.

Also that is a 8xA100 system as others have noted, but it is the 40GB one which can be found on eBay for as low as $3k if you go with the SXM4 one (although the price of supporting components may vary) or $5k for the PCI-e version.

Post reply on HN