Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

How is ChatGPT's behavior changing over time?

arxiv.org

Post reply on HN
Print view View original

161–170 of 187 posts

Re: How is ChatGPT's behavior changing over time?

#161

Post by hutzlibu »

FeepingCreature wrote: post #152
hutzlibu wrote: post #140

Earlier quoted context omitted.

"It'll set up a proper algorithm, step through it and trip over digits." Or it is just pretending to do so. And since it pretends, of course it trips over all small things as it does not understand them.

I don't think you can pretend to properly describe and evaluate an algorithm, anymore than you can pretend to solve a riddle - the answer is either right or it isn't. And in this case, the shape of the answer is often right; it just makes ... ordinary errors. Ironically, the AI is a lot better at high-level thinking than correct calculation.

"Ironically, the AI is a lot better at high-level thinking than correct calculation."

That would be actually a human like feature .. except I do not consider what LLMs are doing as thinking.

Re: How is ChatGPT's behavior changing over time?

#162

Post by tagyro »

I read the paper and while I agree that maybe math is not GPT-4 strongest point, I have noticed the same degradation in quality.

And as I know there will be many commenters asking, here's my experience.

Four months ago I released a mobile app that wraps the "Open"AI API and allows a more private use. The app also includes 15 domains with over 150+ editable prompts, specifically crafted to help users get the most out of GPT.

I initially crafted these prompts in English but given I wanted to allow also non-English speakers to make use of them, I started to translate them in Italian and German.

I wrote a small script that took each English prompt and, with some more prompt-fu, translated them to these languages, using GPT-4.

As I'm fairly fluent in both Italian and German, I was able to verify the quality of these translations.

Well, around end of May, when I first noticed some weird answers from GPT, I ran my script again and (surprise!) the quality of the translations is visible inferior.

On a different note, I noticed that from one day to the other, any prompt would get an empty reply in the app, only to discover that "Open"AI has also made a subtle change in the json format of the API response that made broke the parser in the app.

Admittedly, 150 phrases is not a huge sample size and I could/should have used the default json parser.

I don't trust "Open"AI and will, as soon as it's feasible, change to a different model.

Re: How is ChatGPT's behavior changing over time?

#163

Post by swyx »

s3p wrote: post #42

Commented this on a submission that was a duplicate of this one, but: When GPT's details were allegedly leaked [0] I read about the mixture of experts and wondered if this explains my recent distaste for GPT. Lately I have been using Anthropic's offering (mainly since it is free and has a 100k context window) and I've been surprised at just how well it reasons and understands what I'm asking. It responds like GPT 4 u…

reminder that that "leak" was by a twitter grifter that accessed and reposted wholesale without attribution the contents of a paid newsletter and had the gall to chargeback the credit card. dont encourage him or link to him.

Re: How is ChatGPT's behavior changing over time?

#164

Post by fragmede »

brushfoot wrote: post #125
remus wrote: post #119

Earlier quoted context omitted.

> GPT doing math is like using a 737 to drive around on the ground, or if you had the phone number of a prominent astrophysicist and you call him to do long division for you. I don't think this is a great analogy. if your 737 couldn't drive on the ground and your astrophysicist couldn't answer basic maths questions I wouldn't want to fly in that plane or put much faith in the astrophysicists answers to more complex q…

> asking questions where it is easy to judge the factual accuracy of the responses seems a pretty reasonable test to be running. It isn't reasonable if that isn't what the system was designed to do. It would be a poor test of my general practitioner's competence to ask him calculus questions and conclude he doesn't know what he's talking about because he can't answer them.

Given that a drug's concentration in your bloodstream is absolutely critical for prescribing them, and considering that this is calculated using Calculus, you'd better hope your GP does actually know their Calculus!

Re: How is ChatGPT's behavior changing over time?

#165

Post by [deleted] »

BoorishBears wrote: post #38
Shank wrote: post #34

Earlier quoted context omitted.

> OpenAI would not kneecap their commercial offering by randomly changing how it works. > As of July 3, 2023, we’ve disabled the Browse with Bing beta feature out of an abundance of caution while we fix this in order to do right by content owners. We are working to bring the beta back as quickly as possible, and appreciate your understanding! https://help.openai.com/en/articles/8077698-how-do-i-use-cha...

Thank you for confirming my point? > At the end of the day 99% of the confusion comes from people using the web interface, which undoubtedly does change much more often than the API versions they share. The API does not offer any browsing features, that's the web app.

[deleted]

Re: How is ChatGPT's behavior changing over time?

#166

Post by nomel »

Aulig wrote: post #70

Just yesterday I gave ChatGPT a summarization task and it performed horribly. I even tried multiple times and got the identical answer. Then I gave the identical prompt to gpt-3.5-turbo via the API and I immediately got the expected good answer.

Which gpt-3.5-turbo API? Legacy completion or chat?

Re: How is ChatGPT's behavior changing over time?

#167

Post by qlkjwenf »

NLPaep wrote: post #58
barrkel wrote: post #53

Irritatingly, OpenAI reps deny any change in model capabilities over time. It's more likely that as the models are optimized for cost and performance, their in-house evaluation metrics don't cover everything customers are interested in. Meanwhile, the probabilistic nature of LLM output means there is plausible deniability.

Source? They’ve only denied the API model changing. Not the website.

Some people also say that the earth is flat. Will you believe them?

Re: How is ChatGPT's behavior changing over time?

#168

Post by BoorishBears »

TeMPOraL wrote: post #132
BoorishBears wrote: post #45

Earlier quoted context omitted.

You realize that's a limitation in the web application right? The web app is a consumer app (B2C) the api is commercial (B2B). They tinker with the B2C app because it's already a lossy approximation of using the model between the summarization and system prompt. They cannot mess with the commercial offering willy-nilly: People are building businesses predicated on it behaving a certain way. That's why there are dated…

Arguably, both ChatGPT and API are consumer apps. That includes researchers. Pay as you go, no strings attached, "oh yeah no no, we're not changing anything, follow our CEO on Twitter if you want to know more". That kind of stuff. The actual B2B offering is handled by Microsoft, via Azure OpenAI . Same models, but deployed on Azure - meaning they come with SLA and all the right protocol and compliance stuff, so that…

Maybe arguable if you don't know what consumer apps are? Also sounds like you haven't actually used Azure OpenAI:

- It has the same 30 day retention for legal reasons unless you manually request (just like OpenAI)

- You can't fine tune any models that you can't fine tune on OpenAI, and in fact default access is a subset of what OpenAI offers.

- "and if you're willing to spend enough, you'll get the models for yourself" is a bit of nonsense, Azure OpenAI forces everyone to make a "tenant", that's just for VPC stuff to work. Outside of that it's bog standard fine tuning and at most "on your data" which is a wrapper for chunking + vector embeddings

- Azure OpenAI has a narrower built in filter that you can't modify without again, a separate request.

Azure OpenAI overall is mostly for companies that need to signal to other companies that they're using Azure: it's no more commercial than the OpenAI offering.

Re: How is ChatGPT's behavior changing over time?

#169

Post by BoorishBears »

zo1 wrote: post #82
BoorishBears wrote: post #45

Earlier quoted context omitted.

You realize that's a limitation in the web application right? The web app is a consumer app (B2C) the api is commercial (B2B). They tinker with the B2C app because it's already a lossy approximation of using the model between the summarization and system prompt. They cannot mess with the commercial offering willy-nilly: People are building businesses predicated on it behaving a certain way. That's why there are dated…

You keep repeating that. You don't even know if the people commenting to you use the API or the "web app". I use the API and I noticed the same stuff others have.

> Have you seen the 25 messages/3 hours limitation for GPT-4?

If can't tell if that's about the API or the web app, I don't think you're familiar enough with the subject to speak on it.

Re: How is ChatGPT's behavior changing over time?

#170

Post by python273 »

https://www.aisnakeoil.com/p/is-gpt-4-getting-worse-over-tim...

> The math questions were of the form “Is 17077 prime”? They picked 500 numbers, but all of them were prime!

> The June version of GPT-3.5 and the March version of GPT-4 almost always conclude that the number is prime regardless of whether it is prime or composite. The other two models do the opposite. But the paper only tested prime numbers, and hence concluded that GPT-3.5’s performance improved while GPT-4’s degraded.

Post reply on HN