Live data from Hacker News

Ask HN: How did ChatGPT4 blew your mind lately?

news.ycombinator.com

1–10 of 55 posts

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#2
Honestly, it hasn't. Last night I was trying to use it/Bing to write a simple API request based on a JSON schema, and it failed miserably. Nothing super complicated either, it was just a poor fit. Both GPT3 and GPT4 repeatedly generated nonworking code, which surprised (and frustrated) me.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#3
That i'm finally breaking my "just google it" habits for technical stuff.

Had it write non blocking micro-controller code for a project (about 75% of the output was put into production) it helped making variable names and general structure. The first output was bad because it blocked the button read while "breathing" and led but then I told it: "non blocking code please".

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#4
I asked it to draft a legal document based on some bullet points and it created it, in a different language, in keeping with the legal norms of that country. I sent it to a local lawyer for review and they only came back with very minor things.

Did the reverse with some regulatory documents too, asking it to summarise in vernacular then asking specific questions to better wrap my head around the docs. I wouldn't trust it fully for this of course, more like a supplementary learning aid.

I keep hitting limits with context size though. Eg. When coding it becomes cumbersome once your project hits a certain complexity. You have to carefully construct prompts to get useful outputs. Being able to add the entire source code into a prompt to have more contextual responses would really increase utility.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#5
ChatGPT4 blew my mind when I asked it some specific details about my PhD thesis. It was a relative simple question, but you needed to know some domain knowledge to give the correct answer. ChatGPT not only gave a wrong answer, it completely made up a story was beyond repair. It is concerning (blew my mind) how confident ChatGPT can provide a completely wrong answer.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#6
post #5

ChatGPT4 blew my mind when I asked it some specific details about my PhD thesis. It was a relative simple question, but you needed to know some domain knowledge to give the correct answer. ChatGPT not only gave a wrong answer, it completely made up a story was beyond repair. It is concerning (blew my mind) how confident ChatGPT can provide a completely wrong answer.

Interestingly, I asked about my field of research it just outputed a combination of the two open-access review papers for the field.

It was nothing special, nor not completely correct, but it is the first time I've been able to pinpoint ChatGPTs source.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#8
post #2

Honestly, it hasn't. Last night I was trying to use it/Bing to write a simple API request based on a JSON schema, and it failed miserably. Nothing super complicated either, it was just a poor fit. Both GPT3 and GPT4 repeatedly generated nonworking code, which surprised (and frustrated) me.

I've had astoundingly inconsistent results myself.

Sometimes it'll write really elegant code that just nails the request. Other times it insists the task is impossible ("too complex"). Days later it'll do it without fuss.

I suspect there's some sort of model shell game going on behind the scenes. The best results I get are always outside of business hours.

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#9
post #4

I asked it to draft a legal document based on some bullet points and it created it, in a different language, in keeping with the legal norms of that country. I sent it to a local lawyer for review and they only came back with very minor things. Did the reverse with some regulatory documents too, asking it to summarise in vernacular then asking specific questions to better wrap my head around the docs. I wouldn't trus…

Out of curiosity, are you able to disclose the very minor things? You don't have to use the real terms etc., anonymised are good enough :)

Re: Ask HN: How did ChatGPT4 blew your mind lately?

#10
post #5

ChatGPT4 blew my mind when I asked it some specific details about my PhD thesis. It was a relative simple question, but you needed to know some domain knowledge to give the correct answer. ChatGPT not only gave a wrong answer, it completely made up a story was beyond repair. It is concerning (blew my mind) how confident ChatGPT can provide a completely wrong answer.

Have you pasted (parts of) your thesis as context?
Post reply on HN