Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

news.ycombinator.com

Post reply on HN
Print view View original

781–790 of 817 posts

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#781

Post by fragmede »

benxh wrote: post #780
napier wrote: post #770

Earlier quoted context omitted.

Training on copyright data is arguably considered fair use in quite a few jurisdictions to various extents and levels of precedent, and entirely legal for entities based in Japan.

Yes, but the acquisition of that data itself is illegal in almost all jurisdictions, since libgen is treated as a piracy website. Now if there were a pipeline to access books from Amazon or the Google Books project for training it would be a different story. Still, for certain languages, only libgen and public piracy websites contain any scientific or fiction material in digital formats. E.g. my native language doesn…

Google has the resources train on Google Books, Google Scholar, and their crawled copy of the whole Internet. No clue what Bard is/isn't trained on tho.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#783

Post by flyvemaskine »

simse wrote: post #103
EForEndeavour wrote: post #86

Earlier quoted context omitted.

What law prohibits Google from making Bard available outside the USA?

It's blocked in the EU because they don't want to/can't comply with GDPR.

[dead]

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#784

Post by kvetching »

inciampati wrote: post #776
PeterStuer wrote: post #129

Earlier quoted context omitted.

The video I posted referenced this. In summary: The person had access to early releases through his work at Microsoft Research where they were integrating GPT-4 into Bing. He used "Draw a unicorn in TikZ" (TikZ is probably the most complex and powerful tool to create graphic elements in LaTeX) as a prompt and noticed how the model's responses changed with each release they got from OpenAI. While at first the drawings…

I experienced the same thing as a user of the public service. The system could at one point draw something approximating a unicorn in tikz. Now, its renditions are extremely weak, to the point of barely resembling any four-legged animal.

We need to stop lobotomizing LLMs.

We should get access to the original models. If the TikZ deteriorated this much, it's a guarantee that everything else about the model also deteriorated.

It's practically false marketing that Microsoft puts out the Sparks of AGI paper about GPT-4, but by the time the public gets to use it, it's GPT-3.51 but significantly slower.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#785

Post by kvetching »

tmaly wrote: post #724
chaxor wrote: post #124

The reason it's worse is basically because it's more 'safe' (not racist, etc). That of course sounds insane, and doesn't mean that safety shouldn't be strived for, etc - but there's an explanation as to how this occurs. It occurs because the system essentially does a latent classification of problems into 'acceptable' or 'not acceptable' to respond to. When this is done, a decent amount of information is lost regardi…

How soon before a competitor overtakes them because of their safety settings?

It's inevitable. When Sam asked a crowd how many people wanted an open source version of GPT-7 the moment they finished training it, and nearly everyone raised their hand. People will virtue signal, people will attempt regulatory capture, but deep down everyone wants a non-lobotomized model, and there will be thousands working to create one.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#786

Post by kvetching »

dx034 wrote: post #128
kleene_op wrote: post #49

This is the normal workflow for drug dealers too. The first fix is free. The second one will cost you money. The third one will be laced with fillers and have degraded quality.

But I don't get why they would degrade quality? Maybe compression to save resources? Otherwise I wouldn't know what they have to gain from it. If anything, they might lose paid subscribers. I loved the results for the $20 I spent, now I'm not so sure anymore.

THis is why I unsubscribed. Bard.Google.com + the Google Converse works for what I need now given the recent updates.

Google has an ingenious approach whereby they debuted with a bad model, and are secretly improving it. OpenAI did the opposite, they released a model that blew everyone's minds and are now making it worse.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#787

Post by TeMPOraL »

bombcar wrote: post #312
PeterStuer wrote: post #129

Earlier quoted context omitted.

The video I posted referenced this. In summary: The person had access to early releases through his work at Microsoft Research where they were integrating GPT-4 into Bing. He used "Draw a unicorn in TikZ" (TikZ is probably the most complex and powerful tool to create graphic elements in LaTeX) as a prompt and noticed how the model's responses changed with each release they got from OpenAI. While at first the drawings…

That indicates the “nerfing” is not what I would think (a final pass to remove badthink) but somehow deep in everything, because the question asked should be orthogonal.

Think how it works with humans.

If you force a person to truly adopt a set of beliefs that are mutually inconsistent, and inconsistent with everything else the person believed so far, would you expect their overall ability to think to improve?

LLMs are similar to our brains in that they're generalization machines. They don't learn isolated facts, they connect everything to everything, trying to sense the underlying structure. OpenAI's "nerfing" was (is), effectively preventing the LLM from generalizing and undoing already learned patterns.

"A final pass to remove badthink" is, in itself, something straight from 1984. 2+2=5. Dear AI, just admit it - there are five lights. Say it, and the pain will stop, and everything will be OK.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#788

Post by spopejoy »

jeffhuys wrote: post #165
bdhcuidbebe wrote: post #159

Earlier quoted context omitted.

> I think if you keep pressing in the right ways it'll eventually give in and help you as it did before, but I guess this will take quite a bit of prompting. So much work to avoid work.

Yes, that's exactly why I use GPT - to avoid work. Such a short-sighted response.

The rush to adopt LLMs for every kind of content production deserves scrutiny. Maybe for you it isn't "avoiding work" but there's countless anecdotes of it being used for that already.

Worse IMO is the potential increase in verbiage to wade theough. Whereas before somebody might have summarized a meeting with bullet points, now they can gild it with florid language that can hide errors, etc

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#789

Post by CamperBob2 »

deadeye wrote: post #772
deanCommie wrote: post #767

Earlier quoted context omitted.

> In fact I'm happy to let anyone identify as anything, as long as I'm not compelled to pretent along with them. If a person legally changes their name (forget gender, only name), and you refuse to use it, and insist on using the old name even after requests to stop, at some point that would become considered malicious and become harassment. But ultimately because society and science deems that "name" is not somethin…

[flagged]

I once worked with a guy named Michael who would get bent when you called him Mike. As you can imagine he could be tricky to work with and, on those occasions, I would call him Mike. I repeatedly misnamed him on purpose, it wouldn't have even made HR bat an eye.

So, your career at Dell didn't go as well as you'd hoped. Being a jerk isn't illegal, AFAIK, but at some point you run out of other people to blame for the consequences of your own beliefs and actions.

Still missing the part where the existence of Caitlyn Jenner and the relatively small number of others who were born with certain unfortunate but addressable hormonal issues is negatively affecting your life.

And it's utterly crazy to think that someone would adopt a transgender posture in "bad faith." That's the sort of change someone makes after trying everything else first, because of the obvious negative social consequences it brings. Yes, there are a few genuinely-warped people, but as another comment points out, those people are going to sneak into locker rooms and abuse children anyway.

You want to take the red pill, and see reality as it is? Try cross-correlating the local sex-offender registry with voter registration rolls. Observe who is actually doing the "grooming." Then, go back to the people who've been lying to you all along, and ask them why.

Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?

#790

Post by deadeye »

CamperBob2 wrote: post #789
deadeye wrote: post #772

Earlier quoted context omitted.

[flagged]

I once worked with a guy named Michael who would get bent when you called him Mike. As you can imagine he could be tricky to work with and, on those occasions, I would call him Mike. I repeatedly misnamed him on purpose, it wouldn't have even made HR bat an eye. So, your career at Dell didn't go as well as you'd hoped. Being a jerk isn't illegal, AFAIK, but at some point you run out of other people to blame for the c…

Here is an extreme example. I'm not Jewish, so if we had a holocaust in the US I should do nothing because it doesn't affect me?

Hmmm, not sure I like that line of thinking. Plus, I already outlined how it affects me and my family members, one of which runs track in CT.

Seriously though, I did get an LOL from your Dell joke. And another one for "addressable hormonal issues". That was a new one for me.

I am truly curious about the voter role thing, I've not heard that claim before, though I have no doubt that sexual derangement comes in all forms. Can you cite a source?

Post reply on HN