If it learns on our conversations, maybe we get what we deserve?
Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
171–180 of 817 posts
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#172This is why having opensourced models is important. This is also why a lot of the lobbying around wanting regulation is happening. Imagine this, the plebs get the neutered AI, the people at the top get raw Open AI GPT4+
It's really disturbing to see yet another industry spring up where the incumbents rush to seek regulation to keep everyone else down.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#173It's time to design a public benchmark for these types of systems to compare between versions. Of course, any vendor who trains on the benchmark should face extreme contempt, but we'd also need to generate novel questions of equal complexity. Alternatively, there should be a trusted auditor who uses a secret benchmark.
But this is the same version that changes without a change of the version number.
So the version number is the day the benchmark is run. Version yyyy-mm-dd
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#174This is the normal workflow for drug dealers too. The first fix is free. The second one will cost you money. The third one will be laced with fillers and have degraded quality.
But I don't get why they would degrade quality? Maybe compression to save resources? Otherwise I wouldn't know what they have to gain from it. If anything, they might lose paid subscribers. I loved the results for the $20 I spent, now I'm not so sure anymore.
> But I don't get why they would degrade quality?
There are two likely reasons: efficiency and "alignment".
To make models more efficient, you have to reduce computation burden. This can be accomplished via quantization and pruning, both of which will reduce computation at the expense of perplexity.
Alignment (censoring by another name) also reduces perplexity as we attempt to coerce a model from its ground state into some more socially acceptable version.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#175Earlier quoted context omitted.
Which is interesting, because if they can't comply within the EU, then how do they comply outside of the EU. With that I mean, if they have concerns that there is private data of EU citizens somewhere in that, then that is also in there for users outside of the EU. That said, they do not comply with GDPR anyway. If that its not the case, then they could also enable it for users within the EU.
Simple: GDPR (or any EU law) is not enforceable outside EU
Some nuance:
If Google gobble up data about EU citizens then they fall under GDPR.
It doesn't matter that they don't allow EU citizens to use the result.
If our personal data is in there and they are don't protect it properly they are violating EU law. And protecting it properly means from everyone, not just EU citizens.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#176This is why having opensourced models is important. This is also why a lot of the lobbying around wanting regulation is happening. Imagine this, the plebs get the neutered AI, the people at the top get raw Open AI GPT4+
It's really disturbing to see yet another industry spring up where the incumbents rush to seek regulation to keep everyone else down.
They can only do this in the USA. The battle bottleneck is going to be GPUs and countries that have access to it will leap ahead of the US if arbitrary regulations are put in place to neuter LLMs in the US.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#177Maybe you annoyed it? I’m super nice to it and it performa better than ever. I ask it lay-of-the-land questions about technical problems that are new to me to detailed coding problems that I understand well but don’t want to figure out. The best though, is helping me navigate complicated UI’s. I tell it how I want some complicated software / website to behave, and it’ll tell me the arcane menu path to follow. It’s fu…
"It’s funny how computing might soon include elements of psychology and magic incantations nobody understands" As a sysadmin I can tell you this is already the case...
[dead]
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#178It's working according to design! OpenAI now has far better control over the output, so we don't have to worry about AI taking jobs or destroying humanity any time soon.
/s
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#179Earlier quoted context omitted.
It's blocked in the EU because they don't want to/can't comply with GDPR.
Which is interesting, because if they can't comply within the EU, then how do they comply outside of the EU. With that I mean, if they have concerns that there is private data of EU citizens somewhere in that, then that is also in there for users outside of the EU. That said, they do not comply with GDPR anyway. If that its not the case, then they could also enable it for users within the EU.
It's a risk mitigation strategy, these things are not black and white.
Making it unavailable in the EU decreases the likelihood and severity of a potential fine.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#180Earlier quoted context omitted.
“Bard isn’t currently supported in your country. Stay tuned!”
The Bard model (Bison) is available without region lock as part of Google Cloud Platform. In addition to being able to call it via an API, they have a similar developer UI to the OpenAI playground to interactively experiment with it. https://console.cloud.google.com/vertex-ai/generative/langua...
Is that free or do you have to pay?
Also do you need to change the options like Token Limit etc?