Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

news.ycombinator.com

Post reply on HN
Print view View original

21–30 of 46 posts

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#21

Post by pyyyt »

seertaak wrote: post #15
mvdtnz wrote: post #12

Earlier quoted context omitted.

Hey man I have noticed that virtually all of your contributions to Hacker News have been posts about your own startup. This is bad manners. There's nothing wrong with community members bringing up their own product in the right context, that's totally cool. But the keyword here is "community members". Perhaps you should back off and contribute more meaningfully a bit more.

Isn't the 'hey man' a bit of a leap? From the username it's hard for me to tell, and the profile doesn't mention preferred pronouns. I don't want to start a fight, and basically agree with your comment. It's probably because I'm trans that I really notice pointlessly gendered language, and I just want to mildly make you aware that if you wrote 'hey man' to me (by mistake, no malice presumed) then I'd be a little cres…

[flagged]

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#22

Post by seertaak »

sam_goody wrote: post #18
seertaak wrote: post #15

Earlier quoted context omitted.

Isn't the 'hey man' a bit of a leap? From the username it's hard for me to tell, and the profile doesn't mention preferred pronouns. I don't want to start a fight, and basically agree with your comment. It's probably because I'm trans that I really notice pointlessly gendered language, and I just want to mildly make you aware that if you wrote 'hey man' to me (by mistake, no malice presumed) then I'd be a little cres…

Would you say the same to "Oh, man!", "C'mon man", "man alive", or even (in context) "man overboard"? I don't think these phrases are referring to the subject they are addressing.

I would drop it where an interlocutor is specifically referenced. So 'oh man' is ok. But c'mon man usually expresses disagreement with a specific person. So while I would certainly say c'mon man to a trans or cis masc (which, if I had any shadow of a doubt, I would determine by querying their pronouns, after sharing mine so as not to inadvertently put them on the spot), I would definitely not say it to a trans or cis fem, and also not to an enby.

Someone's life obviously takes priority over gender sensitivity :)

Again, I realize it's a bit of (cognitive) work, and takes some getting used to. But this is hacker news - a certain intellectual pedigree is assumed.

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#23

Post by [deleted] »

seertaak wrote: post #20
extasia wrote: post #16

Earlier quoted context omitted.

I think it's being used endearingly, regardless of the person's gender. I see your point though and can understand how it may make you feel as a transwoman. How might one achieve the same effect with different phrasing?

Heya, I really appreciate you actually listening to what I said, instead of splitting hairs and arguing with me! Empathy is such a lovely quality. To answer your question, I would (did, hihi) drop the 'man'. If you want to remain 'folksy', you could say 'my friend, ...'. Finally, I agree that it was used endearingly - that's why my comment was pretty milquetoast :) I recognize I'm asking you to do something 'extra'.…

[deleted]

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#24

Post by extasia »

seertaak wrote: post #20
extasia wrote: post #16

Earlier quoted context omitted.

I think it's being used endearingly, regardless of the person's gender. I see your point though and can understand how it may make you feel as a transwoman. How might one achieve the same effect with different phrasing?

Heya, I really appreciate you actually listening to what I said, instead of splitting hairs and arguing with me! Empathy is such a lovely quality. To answer your question, I would (did, hihi) drop the 'man'. If you want to remain 'folksy', you could say 'my friend, ...'. Finally, I agree that it was used endearingly - that's why my comment was pretty milquetoast :) I recognize I'm asking you to do something 'extra'.…

Thanks, yeah! Empathy is wonderful:)

Might be a regional thing but "my friend" sounds very condescending / patronising to me! I'd personally feel quite upset if somebody began a critique of my behaviour with that.

I guess "buddy" or "mate" might work though!

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#25

Post by sebastiennight »

jazzyjackson wrote: post #13
briga wrote: post #2

One thing to note when making comparisons like this is that LLM output is not deterministic, in the sense that if you ask it the same question 10 times you will get 10 different answers. So the question to ask is not, “is GPT4 better on this one specific question?”, but rather “does GPT4 produce better results on average?”. I would bet that it does, for no other reason than that it is much larger, and LLM performance…

An unintuitive consequence of this nondeterminism over millions of interactions is that different individuals will see different trends. IME the quality of response is accurately modeled by "luck", and people's luck can change. So we have different population of GPT users. An average experience might be to get a mixture of spot-on helpful responses and obvious bullshit^H^H^Hallucinations, this population might learn…

Interestingly enough, I don't think this applies to the APIs as much.

What I've seen on indie hacker type website is that developers are fully on this train and not very critical of the outputs.

This is why you get very basic prompts sent by "wrapper apps", which might have given the developer a good result the only time it was tested before being put in production.

I think it might take a while before tools show up that can generate 100 test cases and test a given prompt with all 100 to report on the results... It seems to be a tough problem to crack.

IMHO front-end chat end-users have many many more "at-bats" and get to see more model results than devs do, which make them more critical of those results.

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#26

Post by missedthecue »

ideamotor wrote: post #10
tmpz22 wrote: post #8

Its almost as if OpenAI used VC resources to artificially boost their products efficacy during early hype and over time we're seeing the product degrade as the company optimizes for efficiency and profitability and removes its subsidies. Like AirBnB. Or Uber. Etc.

Also like Walmart when they open a store next to a competitor and temporarily drop their price. Or any company with capital ever in existence.

There is no proof this happens beyond internet comments. Smaller stores are simply less efficient and don't benefit from economies of scale, and therefore have higher prices and smaller selection as a result.

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#27

Post by [deleted] »

seertaak wrote: post #15
mvdtnz wrote: post #12

Earlier quoted context omitted.

Hey man I have noticed that virtually all of your contributions to Hacker News have been posts about your own startup. This is bad manners. There's nothing wrong with community members bringing up their own product in the right context, that's totally cool. But the keyword here is "community members". Perhaps you should back off and contribute more meaningfully a bit more.

Isn't the 'hey man' a bit of a leap? From the username it's hard for me to tell, and the profile doesn't mention preferred pronouns. I don't want to start a fight, and basically agree with your comment. It's probably because I'm trans that I really notice pointlessly gendered language, and I just want to mildly make you aware that if you wrote 'hey man' to me (by mistake, no malice presumed) then I'd be a little cres…

[deleted]

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#28

Post by tailspin2019 »

seertaak wrote: post #15
mvdtnz wrote: post #12

Earlier quoted context omitted.

Hey man I have noticed that virtually all of your contributions to Hacker News have been posts about your own startup. This is bad manners. There's nothing wrong with community members bringing up their own product in the right context, that's totally cool. But the keyword here is "community members". Perhaps you should back off and contribute more meaningfully a bit more.

Isn't the 'hey man' a bit of a leap? From the username it's hard for me to tell, and the profile doesn't mention preferred pronouns. I don't want to start a fight, and basically agree with your comment. It's probably because I'm trans that I really notice pointlessly gendered language, and I just want to mildly make you aware that if you wrote 'hey man' to me (by mistake, no malice presumed) then I'd be a little cres…

This was such a brilliantly polite way to make this point!

(And I’m not piling on to the parent because I’m certain I make similar missteps with language sometimes)

Re: Ask HN: Is GPT 4's quality lately worst than GPT 3.5?

#30

Post by porkbeer »

missedthecue wrote: post #26
ideamotor wrote: post #10

Earlier quoted context omitted.

Also like Walmart when they open a store next to a competitor and temporarily drop their price. Or any company with capital ever in existence.

There is no proof this happens beyond internet comments. Smaller stores are simply less efficient and don't benefit from economies of scale, and therefore have higher prices and smaller selection as a result.

It happens enough that there are laws against it buddy.
Post reply on HN