Don’t use ChatGPT to solve problems
thebuild.com
Don’t use ChatGPT to solve problems
1–4 of 4 posts
Re: Don’t use ChatGPT to solve problems
#2Funny, you could say the same about people too, including experts who have misaligned incentives.
Re: Don’t use ChatGPT to solve problems
#3> "In an experiment, I asked 40 questions about PostgreSQL. 23 came back with misleading or simply inaccurate information. Of those, 9 came back with answers that would have caused (at best) performance issues. One of the answers could result in a corrupted database (deleting WAL files to recover disk space)."
I am curious if these tests could be written down and also tested with some versions of GPT (2, 3, 3.5, 4) not because I think they will solve it but to see some trend, and to have a new benchmark if we see 4.5 or 5. Or maybe even test with the 'Code Interpreter' plugin.
Re: Don’t use ChatGPT to solve problems
#4If you aren't showing the prompts and outputs and documenting the model version, you aren't saying anything meaningful.