Okay it's 1pm PT. How are you testing when you get the new features? Just running a curl or something until it works? :)
it is in the playground , otherwise call the model list endpoint.
for me it is available since 12.30
New models and developer products
221–230 of 561 posts
Re: New models and developer products
#222Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…
depends on how much developers are willing to embrace the risk of building everything on OpenAI and getting locked onto their platform. What's stopping OpenAI from cranking up the inference pricing once they choke out the competition? That combined with the expanded context length makes it seem like they are trying to lead developers towards just throwing everything into context without much thought, which could be p…
> depends on how much developers are willing to […] getting locked onto their platform.
I mean.. the lock in risks have been known with every new technology since forever now, and not just the risk but the actual costs are very real. People still buy HP printers with InkDRM and companies willingly write petabytes of data into AWS that they can’t even afford to egress at current prices.
To be clear, I despise this business practice more than most, but those of us who care are screaming into the void. People are surprisingly eager to walk into a leaking boat, as long as thousands of others are as well.
Re: New models and developer products
#223Earlier quoted context omitted.
I haven't been paying attention, why are embeddings not needed anymore?
Retrieval: augments the assistant with knowledge from outside our models, such as proprietary domain data, product information or documents provided by your users. This means you don’t need to compute and store embeddings for your documents, or implement chunking and search algorithms. The Assistants API optimizes what retrieval technique to use based on our experience building knowledge retrieval in ChatGPT. The mod…
> or performs a vector search for longer documents
so, clients upload all their docs to OpenAI database?..
Re: New models and developer products
#224Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…
I haven't been paying attention, why are embeddings not needed anymore?
Embedding is poor man's context length increase. It essentially increases your context length but with loss.
There is a cost argument to make still, embedding-based approach will be cheaper and faster, but worse result than full text.
That being said, I don't see how those embedding startups compete with OpenAI, no one will be able to offer better embedding than OpenAI itself. It is hardly a convincing business.
The elephant in the room is the open source models aren't able to match up to OpenAI models, and it is qualitative, not quantitive.
Re: New models and developer products
#225Earlier quoted context omitted.
they definitely do provide embeddings, https://openai.com/blog/new-models-and-developer-products-an... ctrl+f retrieval, "... won't need to ... compute or store embeddings"
I mean embeddingsDB startups don't provide embeddings. They provide databases which allows to store and query computed embeddings (e.g. computed by ChatGPT), so they are complimentary services.
Yeah I still see a chat bot being able to look for related information in a database as useful. But I see it as just one of many tools a good chat experience will require. 128k context means for me there other applications to explore and larger tasks to accomplish with fewer api requests. Better chat history and context not getting lost
Re: New models and developer products
#226Every day this video ages more and more poorly [1]. categories of startups that will be affected by these launches: - vectorDB startups -> don't need embeddings anymore - file processing startups -> don't need to process files anymore - fine tuning startups -> can fine tune directly from the platform now, with GPT4 fine tuning coming - cost reduction startups -> they literally lowered prices and increased rate limits…
Where is the part about embeddings?
Re: New models and developer products
#227Earlier quoted context omitted.
The investors will only get their 1000x if OpenAI can convince people its risk free to use. So they'll happily cover the legal battle to prove it or spent every last company penny trying
Or, alternatively, copyright risk is a major concern for real customers, and this is a major step forward in addressing that. Not everything needs to be so cynical. What’s good for investors can be good for users as well.
did an AI write this
Re: New models and developer products
#228According to [1], the new gpt-4-1106-preview model should be available to all, but the API is telling me "The model `gpt-4-1106-preview` does not exist or you do not have access to it." Anyone able to call it from the API? 1. https://help.openai.com/en/articles/8555510-gpt-4-turbo
Same. I am eager to run my code editing benchmark [1] against it, to compare it with gpt-4-0314 and gpt-4-0613. Edit: Ha, I just re-read the announcement [2] and it says 1pm in the 5th sentence: We’ll begin rolling out new features to OpenAI customers starting at 1pm PT today. [1] https://aider.chat/docs/benchmarks.html [2] https://openai.com/blog/new-models-and-developer-products-an...
Good find - Looks like I now have access!
Re: New models and developer products
#229> We’re also launching a feature to return the log probabilities for the most likely output tokens generated by GPT-4 Turbo and GPT-3.5 Turbo in the next few weeks, which will be useful for building features such as autocomplete in a search experience. This is very surprising to me. Are they not worried about people not just training on GPT-4 outputs to steal the model capabilities, but doing full blown logit knowled…
I guess the EO takes care of that in their eyes (outlawing open models). They’re probably right too
Re: New models and developer products
#230Earlier quoted context omitted.
[flagged]
> Please don't post insinuations about astroturfing, shilling, brigading, foreign agents, and the like. It degrades discussion and is usually mistaken. If you're worried about abuse, email hn@ycombinator.com and we'll look at the data. https://news.ycombinator.com/newsguidelines.html
likewise, stop posting these references to the guidelines, if you feel the guidelines are being broken report it to the moderators and move on.
This type of post is actually more disruptive than the post you're replying to.