Live data from Hacker News

OpenAI: Increased errors across API and ChatGPT

status.openai.com

31–40 of 67 posts

Re: OpenAI: Increased errors across API and ChatGPT

#32

Has anyone managed to replicate the “search the web” functionality through the API? I’ve set up two “functions” one to get search results and one to extract the text from a search results and feed it back to the AI but I am a bit stuck. What do you use to extract the text from a webpage and how do you handle websites with anti-bot measures?

Shouldn’t the API response be the exact response you would get if you sent the same input to ChatGPT, assuming it’a the same model ?

The API doesn't have access to the web search functionality unless something changed.

Re: OpenAI: Increased errors across API and ChatGPT

#33

Earlier quoted context omitted.

> What happens to the first insert if the second insert violates the constraint? Try it and see? Why do you need an AI to help with this?

Why do you use an internet search engine when you can walk to the library?

The question at hand is pretty easy to test manually and the information you get is much more useful. You will get to see the exact behavior for yourself, can easily build on the test case as related questions come up, and you know the information you are getting is correct rather than a hallucination.

Copying information from ChatGPT is the newer version of blindly copying answers from StackOverflow. It often works out ok and at times makes sense to do, but it can easily lead to software flaws and doesn't do much to build a better undersanding of the domain which is necessary to solve more difficult challenges that don't fit into a Q&A format well.

Re: OpenAI: Increased errors across API and ChatGPT

#34
post #27
post #25

As an FYI, Bing Chat at http://bing.com/chat continues to work even during OpenAI outages. It's also running GPT-4 -- it can be annoying when it reaches out to search, but you can usually explicitly prompt it to not do that.

Yes it’s indeed an option. Note that Creative mode uses GPT-4, not the default Balanced.

What does Balanced use then? 3.5?

Re: OpenAI: Increased errors across API and ChatGPT

#35

> OK I have a table in postgresql and I am adding a trigger such that when an insert happens on that table, an insert happens on another table. The second table has a constraint. What happens to the first insert if the second insert violates the constraint? How can I get help with this now? Google result 1: https://stackoverflow.com/questions/77148711/create-a-trigge... Google result 2: https://dba.stackexchange.com/…

Well, were it possible, I'd say go back in time and study your tools so that you're not spending the journeyman period of your career ricocheting between tutorials and faqs. Failing that, read the documentation. Failing that, stand up a quick experiment. Somehow, we survived before ChatGPT and even before saturated question boards. Those strategies are still available to you and well worth learning

I see your point but the world changes so fast. Back in my day you just needed to learn C, understand algorithms and so on and then you could get deeper in an area or two. Today, you need to understand and be able to proficiently use so many technologies that you can feel lost.

And this is what happens when, say, you loose a job you've been doing for 10-15 years. You need to re-learn the world. And a lifetime is not enough to do it the way we used to do it.

Re: OpenAI: Increased errors across API and ChatGPT

#36

I think we need a new type of status page or at least a public version number on llms, yesterday for me GPT4 started giving nonsense super generic answers, like it was hardly reading what I wrote, and today it is back to top notch performance. I think they were trying to make the model more efficient or something but I just saw a massive decrease in the quality of output. From my side though, there is no version numb…

This conspiracy always comes up - don't you think that they test the output of the model revisions on probably 1000s of downstream tasks at this point? Bad responses are hard to reason about, could be prompting, could be a model revision, could just be bad luck.

Or maybe they are just AB testing and aggressively optimizing the response generation?

LLMs are known to be compute/energy hungry to execute. It is a developing technology, if not downright experimental.

Therefore, this explanation is very likely. I cannot see the reason to call this a conspiracy.

Re: OpenAI: Increased errors across API and ChatGPT

#37

> OK I have a table in postgresql and I am adding a trigger such that when an insert happens on that table, an insert happens on another table. The second table has a constraint. What happens to the first insert if the second insert violates the constraint? How can I get help with this now? Google result 1: https://stackoverflow.com/questions/77148711/create-a-trigge... Google result 2: https://dba.stackexchange.com/…

Well, were it possible, I'd say go back in time and study your tools so that you're not spending the journeyman period of your career ricocheting between tutorials and faqs. Failing that, read the documentation. Failing that, stand up a quick experiment. Somehow, we survived before ChatGPT and even before saturated question boards. Those strategies are still available to you and well worth learning

I'd go straight to the experiment, create the tables on a local postgresdb and try to get it to work.

Re: OpenAI: Increased errors across API and ChatGPT

#38
post #33

Earlier quoted context omitted.

Why do you use an internet search engine when you can walk to the library?

The question at hand is pretty easy to test manually and the information you get is much more useful. You will get to see the exact behavior for yourself, can easily build on the test case as related questions come up, and you know the information you are getting is correct rather than a hallucination. Copying information from ChatGPT is the newer version of blindly copying answers from StackOverflow. It often works…

In my experience, I encounter more issues and waste more time when I fiddle on my own and try stuff compared to doing the same, but using chatGPT.

There is a lot of knowledge that I don’t want to have expertise with. Sure, I could carefully read the PostgreSQL documentation about triggers and implement it myself, or I could get the job done in a few minutes and procrastinate on HN instead.

Re: OpenAI: Increased errors across API and ChatGPT

#39

Same for the past 30+ minutes was surprised not to see it on HN but guess it just took a little time for someone to post. Tried Bard and reminded me how far behind it is when asking programmer questions.

I am finding Bard almost comparable. Gpt quality is declining I think.

Wouldn't surprise me if bard permanently surpasses gpt in the next quarter. Particularly if openai is dialing down quality...

Re: OpenAI: Increased errors across API and ChatGPT

#40

> OK I have a table in postgresql and I am adding a trigger such that when an insert happens on that table, an insert happens on another table. The second table has a constraint. What happens to the first insert if the second insert violates the constraint? How can I get help with this now? Google result 1: https://stackoverflow.com/questions/77148711/create-a-trigge... Google result 2: https://dba.stackexchange.com/…

Well, were it possible, I'd say go back in time and study your tools so that you're not spending the journeyman period of your career ricocheting between tutorials and faqs. Failing that, read the documentation. Failing that, stand up a quick experiment. Somehow, we survived before ChatGPT and even before saturated question boards. Those strategies are still available to you and well worth learning

The "good old days weren't always good". I'm tired of either limiting myself to the information I have on the top of my head, the LLMs are really helping allow me to be creative and stretch out to do things that are just beyond my bread and butter, or things that I do infrequently.
Post reply on HN