did they break the api?
from openai import OpenAI
Traceback (most recent call last): File "", line 1, in ImportError: cannot import name 'OpenAI' from 'openai'
If so where is the current documentation?
New models and developer products
131–140 of 561 posts
Re: New models and developer products
#132JSON mode is a great step in the right direction, but the holy grail is either JSON-schema support or (E)BNF grammar specification.
The function calling is JSON Schema support but extremely poorly marketed. I am planning on writing a blog post about it.
Re: New models and developer products
#133Earlier quoted context omitted.
I haven't been paying attention, why are embeddings not needed anymore?
OP is incorrect. Embeddings are still needed since (1) context windows can't contain all data and (2) data memorization and continuous retraining is not yet viable.
But the common use case of using a vector DB to pull in augmentation appears to now be handled by the Assistants API. I haven't dug into the details yet but it appears you can upload files and the contents will be used (likely with some sort of vector searching happening behind the scenes).
Re: New models and developer products
#134Excited to see GPT4-Turbo and longer sequence lengths from OpenAI. We just released Vectara's "Hallucination Evaluation Model" (aka HEM) today https://huggingface.co/vectara/hallucination_evaluation_mode... (along with this leaderboard: https://github.com/vectara/hallucination-leaderboard).
GPT-4 was already in the lead. Looking forward to seeing GPT4-Turbo there soon.
Re: New models and developer products
#135This is kind of the wrong place for this, but given the burst of attention from LLM-loving people: is there any open source chat scaffolding that actually provides a good UI for organizing chat streams and doing stuff with them? A trivial example is how the LHS of the ChatGPT UI only allows you a handful of characters to name your chat, and you can't even drag the pane to the right to make it bigger; so I have all th…
I agree why not vector search for history.
Re: New models and developer products
#136The 128k context window GPT-4 Turbo model looks unreal. Seems like Anthropic's day of reckoning is here?
Anthropic's $20 billion valuation is buck wild, especially to those who've used their "flagship" model. The thing is insufferable. David Shapiro sums it up nicely.[1] Fighting tools is horrendous enough. Those tools also deceiving and lecturing you regarding benign topics is inexcusable. I suspect that this behavior is a side-effect of Anthropic's fetishistic AI safety obsession. I further suspect that the more one brain washes their agent into behaving "acceptably", the more it'll backfire with erratic and useless behavior. Just like with humans, the antidote to harmful action is more free thought and education, not less. Punishment methods rooted in fear and insecurity will result in fearful and insecure AI (i.e ironically creating the worst outcome we're all trying to avoid).
Re: New models and developer products
#137This is kind of the wrong place for this, but given the burst of attention from LLM-loving people: is there any open source chat scaffolding that actually provides a good UI for organizing chat streams and doing stuff with them? A trivial example is how the LHS of the ChatGPT UI only allows you a handful of characters to name your chat, and you can't even drag the pane to the right to make it bigger; so I have all th…
Organize how?
tree structure. like email.
Re: New models and developer products
#138This is kind of the wrong place for this, but given the burst of attention from LLM-loving people: is there any open source chat scaffolding that actually provides a good UI for organizing chat streams and doing stuff with them? A trivial example is how the LHS of the ChatGPT UI only allows you a handful of characters to name your chat, and you can't even drag the pane to the right to make it bigger; so I have all th…
This may not be useful to you, but there are browser extensions that add a bunch of functionality to ChatGPT.
The first that comes to mind: https://chrome.google.com/webstore/detail/superpower-chatgpt...
Re: New models and developer products
#139Earlier quoted context omitted.
OP is incorrect. Embeddings are still needed since (1) context windows can't contain all data and (2) data memorization and continuous retraining is not yet viable.
"yet"
It's also much slower. LLMs are generating text token at a time. That's not very good for search.
Pre-search tokenization however, probably a good fit for LLMs.
Re: New models and developer products
#140So with 128K context window, if you actually input 100K it would cost you: Input: $0.01 per 1K tokens * 100 = $1.00 $1.00 per query? Given that each query uses the entire context window, the session would start at $1 for the first query and go up from there? Or do I have it wrong?
It would be $1 for each individual API call, if you were continuing the conversation based on the same 100K input. ChatGPT is stateless.