Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: How did ChatGPT4 blew your mind lately?

news.ycombinator.com

Post reply on HN
Print view View original

41–50 of 55 posts

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#41

Post by muzani »

lukevp wrote: post #13

I see a lot of replies here talking about asking GPT questions in a domain an individual is an expert in, and being disappointed in the results. I think this is missing the point a bit. The impressive part of GPT isn’t that it’s an expert in anything, but that it’s better than an average human on many topics. For example - someone brought up GPT not comprehending homomorphic encryption fully. Well, I have a MS in CS…

GPT-4 has once solved a bug in an hour that took me a day.

It wasn't because it was a superintelligent entity, but because it was an intelligent scientific logbook.

It would break down possible root causes of the bug. I could add more if it misses any. It would give me the simplest possible solution to test each one. Sometimes it's not right and I have a simpler test.

But it'll track which ones we have tried so we don't go in circles with debugging. It's really a superior rubber duck + notepad.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#42

Post by kian »

muzani wrote: post #41
lukevp wrote: post #13

I see a lot of replies here talking about asking GPT questions in a domain an individual is an expert in, and being disappointed in the results. I think this is missing the point a bit. The impressive part of GPT isn’t that it’s an expert in anything, but that it’s better than an average human on many topics. For example - someone brought up GPT not comprehending homomorphic encryption fully. Well, I have a MS in CS…

GPT-4 has once solved a bug in an hour that took me a day. It wasn't because it was a superintelligent entity, but because it was an intelligent scientific logbook. It would break down possible root causes of the bug. I could add more if it misses any. It would give me the simplest possible solution to test each one. Sometimes it's not right and I have a simpler test. But it'll track which ones we have tried so we do…

Is there a way to reach you to talk about this further?

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#43

Post by muzani »

kian wrote: post #42
muzani wrote: post #41

Earlier quoted context omitted.

GPT-4 has once solved a bug in an hour that took me a day. It wasn't because it was a superintelligent entity, but because it was an intelligent scientific logbook. It would break down possible root causes of the bug. I could add more if it misses any. It would give me the simplest possible solution to test each one. Sometimes it's not right and I have a simpler test. But it'll track which ones we have tried so we do…

Is there a way to reach you to talk about this further?

Sure, my email is in my profile.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#44

Post by endorphine »

taf2 wrote: post #39
noud wrote: post #5

ChatGPT4 blew my mind when I asked it some specific details about my PhD thesis. It was a relative simple question, but you needed to know some domain knowledge to give the correct answer. ChatGPT not only gave a wrong answer, it completely made up a story was beyond repair. It is concerning (blew my mind) how confident ChatGPT can provide a completely wrong answer.

Was it GPT-4 or ChatGPT?

What's the difference? Doesn't ChatGPT uses GTP-4?

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#45

Post by noud »

lukevp wrote: post #13

I see a lot of replies here talking about asking GPT questions in a domain an individual is an expert in, and being disappointed in the results. I think this is missing the point a bit. The impressive part of GPT isn’t that it’s an expert in anything, but that it’s better than an average human on many topics. For example - someone brought up GPT not comprehending homomorphic encryption fully. Well, I have a MS in CS…

Who is wiser? One who doesn't know much, but knows what he doesn't know and points this out when asked. Or the one who knows a lot, but doesn't know what he doesn't know, and (confidently) makes up something when he doesn't know? (also see Apology from Plato)

I'm not disappointed that GPT doesn't know the answers to questions in my domain of expertise. I'm disappointed that GPT doesn't know that it isn't an expert in my domain, and makes up a confident but wrong answers.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#46

Post by jstx1 »

1270018080 wrote: post #29

What really blows my mind is that people are using a language model to do anything important with confidence.

Compare it to reading stackoverflow or a tutorial on something that you can't quite do yet - the answer on SO might be wrong, or it might work in a different context from yours, or might work but not be the optimal solution; the tutorial might be out of date or it might have been incorrect from the start. But SO and tutorials are still very useful if you're smart about hwo you use them.

Same thing with ChatGPT - having a general interactive "answer-anything, tutor-me-on-anything" tool is a big deal; you just need to be smart about how you use it (prompting it well, verifying the outputs), and the results are surprisingly good especially with GPT-4.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#48

Post by FabianBeiner »

endorphine wrote: post #44
taf2 wrote: post #39

Earlier quoted context omitted.

Was it GPT-4 or ChatGPT?

What's the difference? Doesn't ChatGPT uses GTP-4?

Currently, by default, it uses 3.5. Premium allows you to switch to 4, but it's rather limited (25 messages every 3 hours or so).

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#49

Post by endorphine »

FabianBeiner wrote: post #48
endorphine wrote: post #44

Earlier quoted context omitted.

What's the difference? Doesn't ChatGPT uses GTP-4?

Currently, by default, it uses 3.5. Premium allows you to switch to 4, but it's rather limited (25 messages every 3 hours or so).

Ok, so by "ChatGPT" parent means "ChatGPT using GPT-3.5"

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#50

Post by xory »

When 4 perfectly followed a complex prompt that I had spent hours trying (unsuccessfully) to get 3.5-turbo to follow even somewhat acceptably. Both models continue to impress me with their ability to tell me how to tune my prompts to get better results more consistently.
Post reply on HN