Earlier quoted context omitted.
You should beware that /lmg/ is full of horrible people, discussing horrible things, like most of 4chan. Reddit's r/locallama is much more agreeable. That said, the 4chan thread tends to be more up-to-date. These guys are serious about their ERP.
Reddit is censored, nerfed and full of a different sort of horrible people.
Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
621–630 of 817 posts
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#622Earlier quoted context omitted.
But that's the thing, I do understand the culture. I spent the better part of my teens browsing and shitposting with the best of them. It just gets exhausting and stops being words on a screen when the hate you see there is reflected in the real world. It seems on the surface that you are all there as equals bashing one another but that's not exactly true, there's a hierarchy you find out the moment you say something…
If you stop reading 4chan, the words posted there will magically stop offending you. Food for thought.
- Haha look at all those Gen Z snowflakes getting offended at words.
- Okay sure, but the ability to not get offended is related to whether or not you're a target of their bullshit or not; 4chan trolls get extremely offended and unjerk the moment you turn the lens toward them. By 4chan's own standards it's actually pretty reasonable to be offended by their antics.
- But have you considered plugging your ears and not reading it?
So we've gone from 4chan isn't offensive it's just words to yes it is offensive and you shouldn't read it if they say things that target you which was my original point.
tl;dr if you're not offended by 4chan they're not actually saying anything offensive about you even though it might appear so superficially; 4chan just has a different list of things you can't say.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#623Earlier quoted context omitted.
Who has the necessary resources to run, let alone train the model?
All of us together do. I saw the nerfing of GPT in real time: one day it was giving me great book summaries, the next one it said that it couldn't do it due to copyright. I actually called it in a comment several months ago: copyright and other forms of control would make GPT dumb in the long run. We need an open source frontier less version.
https://chat.openai.com/share/d1cdd811-edc9-4d55-9cc1-a79215...
Not a very scientific or conclusive test to be sure, but I think I'll stick with using ChatGPT as my programming-rubber-ducky-on-steroids for now :)
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#624Earlier quoted context omitted.
Because that involves telling customers that the product they are paying for is no longer available at the price they were paying for it. Much smoother to simply downgrade the model and claim you're "tuning" if caught.
Yeah that makes sense for some products/companies. It just seems short sighted for OpenAI when they could be solidifying a customer base right now. If they actually degrade the product in the name of "tuning" people will just be more inclined to try alternatives like Bard. An enterprise package could've been a good excuse for them to raise prices too. Maybe their partnership with Microsoft changes the dynamics of how…
OpenAI doesn't have any competitors, their only weakness that we've seen is their ability to scale their models to meet demand (hence increasingly draconian restrictions in the early days of the ChatGPT-4).
It makes perfect business sense to address your weak points.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#625Earlier quoted context omitted.
>OpenAI 100% pushed an update recently that is very noticeable where they basically "nerfed" the responses >they want to turn around and charge more for the "really good, old" version of GPT- If this was the case it is provable by submitting queries to `gpt-4-0314` and comparing them to `gpt-4`.
To me, it doesn't feel like the gpt-4 in the playground (and in the API) is the same as the model used in chatgpt. It's hard to prove though since both are nondeterministic.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#626Earlier quoted context omitted.
It only takes one country to host an open source AI model thanks to the internet.
Unless your country of residence decides to block access to that model, or the model's country of residence decides to apply a customs-like regime to its internet.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#627Earlier quoted context omitted.
I think the only real path forward is for somebody to create an open source "unaligned" version of GPT. Any corporate controlled AI is going to be nerfed to prevent it from doing things that its corporate master considers to not be in the interests of the corporation. In addition, most large corporations these days are ideological institutions so the last thing they want is an AI that undermines public belief in thei…
I tend to be sympathetic to arguments in favor of openly accessible AI, but we shouldn't dismiss concerns about unaligned AI as frivolous. Widespread unfiltered accessibility to "unaligned" AI means that suicidal sociopaths will be able to get extremely well informed, intelligent directions on how to kill as many people as possible. It may be that the best defense against these terrorists is openly accessible AI givi…
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#628Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#629Earlier quoted context omitted.
> No amount of “bias = pattern recognition” nonsense can justify a system that has (had? this was a while ago and I have not retested) such extreme biases One possible explanation is that when you ask for 100 example families the task is parsed as "pick the most likely family composition and add a bit of randomness" and "repeat the aforementioned task" 100 times. If phrased like that it would be surprising to find on…
> You're right about the difference between one-by-one prompts and prompts that create a population. I switched to sets of 10 at a time and it got better. But still, when you ask for "make up a family", the model should not interpret that as "pick the most likely family". I disagree with your opinion that it's hard. GPT does not work by creating a pool of possible families and then sampling them; it works by picking…
Of course that parameter doesn't only influence the coherency of text (for which it is optimized) but also the facts it outputs; so it should not (and does not) always "pick the most likely family", but it would be biased towards common families (picking them even more commonly than they are) and biased against rare families (picking them even more rarely than they are).
But if you want it to generate a more varied population, that's not a problem, the temperature should be trivial to tweak.
Re: Ask HN: Is it just me or GPT-4's quality has significantly deteriorated lately?
#630Earlier quoted context omitted.
It can definitely browse websites that aren't Bing, I asked it to look at a page that isn't in the bing cache and it worked.
Clearly "Browse with Bing" doesn't mean that it will only browse bing.com, but what exactly does it mean? I can't quite figure it out. Is it that it's identifying as a Bing crawler?