Has anyone put out a voice-to-text interface for OpenAI? Or anything in the Ollama-verse?
OpenAI has a voice to text interface for OpenAI…
OpenAI: Streaming is now available in the Assistants API
11–20 of 89 posts
Re: OpenAI: Streaming is now available in the Assistants API
#12Any way to have a consistent system prompt across queries without sending it (and using tokens) for each completion?
The Assistant API handles that, it has the system prompt as part of the assistant that you interact with.
And can you share the assistant with other users?
Also, the system prompt in assistants doesn't consume tokens?
Re: OpenAI: Streaming is now available in the Assistants API
#13This was one of the limitations of the Assistants API that made me entirely ignore it up until now.
I am curious if the Assistants API lets you edit/remove/retry messages yet. I don't see anything implying this has changed. It's annoying that the Assistants API doesn't give you enough control to support basic things that the ChatGPT app does.
Re: OpenAI: Streaming is now available in the Assistants API
#14This was one of the limitations of the Assistants API that made me entirely ignore it up until now. I am curious if the Assistants API lets you edit/remove/retry messages yet. I don't see anything implying this has changed. It's annoying that the Assistants API doesn't give you enough control to support basic things that the ChatGPT app does.
Edit/remove/retry is just including the whole conversation over again (IIUC this is even how the app works.) It's part of why the API is so expensive
Re: OpenAI: Streaming is now available in the Assistants API
#15Finally! I've been using the assistants api in building an ai mock interviewer ( https://comp.lol ) but the responses were painfully slow when using the latest iterations of the gpt-4 model. This will make things so much more responsive
I'd still want to see the entire response all at once. Having it stream in while I read it would be very distracting and make it difficult for me to read.
yes, it like surfing porn in the early internet year using a dialup modem. One line a the time until you finally can see enough of the picture (reply) to realize that is was not the reply you were looking for.
LLM streaming must be a cost saving feature to prevent you from overloading the servers by asking to many questions with in a short time frame. Annoying feature IMHO
Re: OpenAI: Streaming is now available in the Assistants API
#16Finally! I've been using the assistants api in building an ai mock interviewer ( https://comp.lol ) but the responses were painfully slow when using the latest iterations of the gpt-4 model. This will make things so much more responsive
Same it was super slow and unusable when I tried. 10 seconds for a reply or smth. GPT4 API itself was way faster
Re: OpenAI: Streaming is now available in the Assistants API
#17This was one of the limitations of the Assistants API that made me entirely ignore it up until now. I am curious if the Assistants API lets you edit/remove/retry messages yet. I don't see anything implying this has changed. It's annoying that the Assistants API doesn't give you enough control to support basic things that the ChatGPT app does.
Like the other commenter said, edit/remove/retry messages can be implemented by the API client already. The API doesn't maintain state so every new message in a "conversation" includes previous messages as context. To edit a message you would re-submit the conversation history with the desired changes.
I get what you're asking for though. It would be nice if this was easier. But that would require OpenAI changing their API model to one where conversation history is stored on their server. It would be more of a "ChatGPT conversation API" then just an GPT-4/3.5 API.
Re: OpenAI: Streaming is now available in the Assistants API
#18Re: OpenAI: Streaming is now available in the Assistants API
#19This was one of the limitations of the Assistants API that made me entirely ignore it up until now. I am curious if the Assistants API lets you edit/remove/retry messages yet. I don't see anything implying this has changed. It's annoying that the Assistants API doesn't give you enough control to support basic things that the ChatGPT app does.
Edit/remove/retry is just including the whole conversation over again (IIUC this is even how the app works.) It's part of why the API is so expensive
The Assistants API doesn't let you recreate the conversation (with edits or not) because you can't (re)create messages with role=assistant.
Re: OpenAI: Streaming is now available in the Assistants API
#20Openai banned my account for suspicious payment activities, and I never was able to talk to a real person. Just several layers of chat bots posing as people.
I literally want to give them my money and can't. Every few weeks for shirts and giggles i send an email to them saying, "any update on this?"