Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

New models and developer products

openai.com

Post reply on HN
Print view View original

201–210 of 561 posts

Re: New models and developer products

#201

Post by 0xDEF »

raylad wrote: post #115

So with 128K context window, if you actually input 100K it would cost you: Input: $0.01 per 1K tokens * 100 = $1.00 $1.00 per query? Given that each query uses the entire context window, the session would start at $1 for the first query and go up from there? Or do I have it wrong?

If it truly is GPT-4+ with a 128K context window it's still absolutely worth the high price. That is literally 300 pages. However if they are cheating like everyone else who has promised gigantic context windows then we are better off with RAG and a vector database.

Re: New models and developer products

#202

Post by kridsdale3 »

in3d wrote: post #17
zavertnik wrote: post #13

And here I was in bliss with the 32k context increase 3 days ago. 128k context? Absolutely insane. It feels like now the bottle neck in GPT workflows is no longer GPT, but instead its the wallet! Such an amazing time to be alive.

For GPT-4 Turbo, not GPT-4.

Yes, nowhere in the text today was there any assertion that Turbo produces (eg) source code at the same level of coherence and consistently high quality as GPT4.

Re: New models and developer products

#203

Post by sbohacek »

infecto wrote: post #26
crakenzak wrote: post #5

The 128k context window GPT-4 Turbo model looks unreal. Seems like Anthropic's day of reckoning is here?

Anthropic never even had a day. I said this before in another Anthropic thread but I signed up 6 months ago for API access and they never responded. An employee in that thread apologized and said to try again, did it, week later still nothing. As far as commercial viability, they never had it.

I have not tried, but I assumed that API access to Anthropic's Claude is available through AWS Bedrock.

Re: New models and developer products

#204

Post by 0xDEF »

conorh wrote: post #168

We just changed a project we've been working on to try out the new gpt-4-turbo model and it is MUCH faster. I don't know if this is a factor of the number of people using it or not, but streaming a response for the prompts we are interested in went from 40-50 seconds to 6 seconds.

I noticed that too but I think it's because we are hitting new servers that just went online. They will probably get saturated and slower with time when other gpt-4 users start using gpt-4-turbo.

Re: New models and developer products

#205

Post by hyperthesis »

bluck wrote: post #164

Copyright Shield > OpenAI is committed to protecting our customers with built-in copyright safeguards in our systems. Today, we’re going one step further and introducing Copyright Shield—we will now step in and defend our customers, and pay the costs incurred, if you face legal claims around copyright infringement. This applies to generally available features of ChatGPT Enterprise and our developer platform. So essen…

costs != damages

Re: New models and developer products

#207

Post by kridsdale3 »

a_wild_dandan wrote: post #136
crakenzak wrote: post #5

The 128k context window GPT-4 Turbo model looks unreal. Seems like Anthropic's day of reckoning is here?

Anthropic's $20 billion valuation is buck wild, especially to those who've used their "flagship" model. The thing is insufferable. David Shapiro sums it up nicely.[1] Fighting tools is horrendous enough. Those tools also deceiving and lecturing you regarding benign topics is inexcusable. I suspect that this behavior is a side-effect of Anthropic's fetishistic AI safety obsession. I further suspect that the more one b…

Anthropic's valuation has nothing to do with their product being actually good. It is entirely tied up in the perception of built-in risk-mitigation which appeals to client companies that are actually run by lawyers and not product folks.

Products backed by nanny-state LLMs are going to fail in the market. The TAM for the products is tiny, basically the same as Christian Music or Faith-Based Filmmaking.

People love porn and violence.

Re: New models and developer products

#208

Post by shmatt »

bluck wrote: post #164

Copyright Shield > OpenAI is committed to protecting our customers with built-in copyright safeguards in our systems. Today, we’re going one step further and introducing Copyright Shield—we will now step in and defend our customers, and pay the costs incurred, if you face legal claims around copyright infringement. This applies to generally available features of ChatGPT Enterprise and our developer platform. So essen…

The investors will only get their 1000x if OpenAI can convince people its risk free to use. So they'll happily cover the legal battle to prove it or spent every last company penny trying

Re: New models and developer products

#210

Post by razodactyl »

a_wild_dandan wrote: post #136
crakenzak wrote: post #5

The 128k context window GPT-4 Turbo model looks unreal. Seems like Anthropic's day of reckoning is here?

Anthropic's $20 billion valuation is buck wild, especially to those who've used their "flagship" model. The thing is insufferable. David Shapiro sums it up nicely.[1] Fighting tools is horrendous enough. Those tools also deceiving and lecturing you regarding benign topics is inexcusable. I suspect that this behavior is a side-effect of Anthropic's fetishistic AI safety obsession. I further suspect that the more one b…

The model responses are a side-effect of AI reinforcement training in lieu of humans.

The trick is to write as if it were the AI calling the shots.

Set up an agreement on the requirement. Then Force the first word the Assistant: says to "Sure"

Post reply on HN