Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New models and developer products

openai.com

Post reply on HN
Print view View original

141–150 of 561 posts

Re: New models and developer products

#141

Post by m3kw9 »

bluecrab wrote: post #119
whytai wrote: post #71

Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…

Vector DBs should never have existed in the first place. I feel sorry for the agent startups though.

How does this absolve vectordbs

Re: New models and developer products

#142

Post by parkerhiggins »

ushakov wrote: post #96
morkalork wrote: post #87

Earlier quoted context omitted.

If you want to be a start-up using AI, you have to be in another industry with access to data and a market that OpenAI/MS/Google can't or won't touch. Otherwise you end up eaten like above.

We just launched our AI-based API-Testing tool ( https://ai.stepci.com ), despite having competitors like GitHub Co-Pilot. Why? Because they lack specificity. We're domain experts, we know how to prompt it correctly to get the best results for a given domain. The moat is having model do one task extremely well rather than do 100 things "alright"

Domain specialization could be the moat, not only in the business domain but the sheer cost of deployment/refinement.

Check out Will Bennett's "Small language models and building defensibility" - https://will-bennett.beehiiv.com/p/small-language-models-and... (free email newsletter subscription required)

Re: New models and developer products

#143

Post by raylad »

minimaxir wrote: post #140
raylad wrote: post #115

So with 128K context window, if you actually input 100K it would cost you: Input: $0.01 per 1K tokens * 100 = $1.00 $1.00 per query? Given that each query uses the entire context window, the session would start at $1 for the first query and go up from there? Or do I have it wrong?

It would be $1 for each individual API call, if you were continuing the conversation based on the same 100K input. ChatGPT is stateless.

Right, so that adds up very fast.

Re: New models and developer products

#144

Post by sharemywin »

gumballindie wrote: post #32
Zaheer wrote: post #15

The playbook OpenAI is following is similar to AWS. Start with the primitives (Text generation, Image generation, etc / EC2, S3, RDS, etc) and build value add services on top of it (Assistants API / all other AWS services). They're miles ahead of AWS and other competitors in this regard.

And just like amazon they will compete with their own customers. They are miles ahead in this regard as well since they basically take everyone’s digital property and resell it.

don't hate the player hate the game.

Re: New models and developer products

#147

Post by davidbarker »

taf2 wrote: post #114
tornato7 wrote: post #58

A few notes on pricing: - GPT-4 Turbo vision is much cheaper than I expected. A 768*768 px image costs $0.00765 to input. That's practical to replace more specialized computer vision models for many use-cases. - ElevenLabs is $0.24 per 1K characters while OpenAI TTS HD is $0.03 per 1K characters. Elevenlabs still has voice copying but for many use-cases it's no longer competitive. - It appears that there's no additio…

Does this mean OpenAI tts is available via api? I saw whisper but not tts - maybe I’m missing it?

It is, indeed!

https://platform.openai.com/docs/guides/text-to-speech

Re: New models and developer products

#148

Post by bluecrab »

infecto wrote: post #26
crakenzak wrote: post #5

The 128k context window GPT-4 Turbo model looks unreal. Seems like Anthropic's day of reckoning is here?

Anthropic never even had a day. I said this before in another Anthropic thread but I signed up 6 months ago for API access and they never responded. An employee in that thread apologized and said to try again, did it, week later still nothing. As far as commercial viability, they never had it.

They can't even compete with open source since multiple platforms have apis available.

Re: New models and developer products

#149

Post by danielbln »

m3kw9 wrote: post #141
bluecrab wrote: post #119

Earlier quoted context omitted.

Vector DBs should never have existed in the first place. I feel sorry for the agent startups though.

How does this absolve vectordbs

It doesn't, but semantic search is a lot less relevant if you can squeeze 350 pages of text into the context.

Re: New models and developer products

#150

Post by dragonwriter »

m3kw9 wrote: post #141
bluecrab wrote: post #119

Earlier quoted context omitted.

Vector DBs should never have existed in the first place. I feel sorry for the agent startups though.

How does this absolve vectordbs

If you are using OpenAI, the new Assistants API looks like itnwill handle internally what you used to handle externally with a vector DB for RAG (and for some things, GPT-4-Turbo’s 128k context window will make it unnecessary entirely.) There are some other uses for Vector DBs than RAG for LLMs, and there are reasons people might use non-OpenAI LLMs with RAG, so there is still a role for VectorDBs, but it shrunk a lot with this.
Post reply on HN