[deleted]
[deleted]
ChatGPT generates fake data set to support scientific hypothesis
11–20 of 159 posts
Re: ChatGPT generates fake data set to support scientific hypothesis
#12For anyone jumping in who hasn't read the article, this is not about hallucinations and some researchers being surprised that GPT-4 doesn't always respond with absolute truth.
Instead it's about how easily it can be used to generate plausible looking datasets that would confirm a hypothesis. It's a warning note to journals about how fake data can more easily be created.
Re: ChatGPT generates fake data set to support scientific hypothesis
#13[deleted]
Re: ChatGPT generates fake data set to support scientific hypothesis
#14[deleted]
Re: ChatGPT generates fake data set to support scientific hypothesis
#15This is not particularly surprising, nor is it really bad - generating data that appears valid is really powerful. Although it was a bit funny since I happen to have keratoconus, and I don't hear much about it often.
Re: ChatGPT generates fake data set to support scientific hypothesis
#16>“It will make it very easy for any researcher or group of researchers to create fake measurements on non-existent patients, fake answers to questionnaires or to generate a large data set on animal experiments.”
Perhaps I'm naive, but I think the people that want to fake data were already doing it without tools like chatgpt. Especially since a ton of biological data is normally distributed, so it's exceedingly easy to generate plausible fake results for such data without a system as advanced as chatgpt
Re: ChatGPT generates fake data set to support scientific hypothesis
#17For anyone jumping in who hasn't read the article, this is not about hallucinations and some researchers being surprised that GPT-4 doesn't always respond with absolute truth. Instead it's about how easily it can be used to generate plausible looking datasets that would confirm a hypothesis. It's a warning note to journals about how fake data can more easily be created.
Exactly. It's no different from the fake data sets created by hand in scientific misconduct cases for years, just I guess easier. I guess that's not a good thing, but given even making a fake data set by hand is far easier than generating real data, I'm not sure if this will suddenly make more people fake data.
Re: ChatGPT generates fake data set to support scientific hypothesis
#18Working in analytics long enough has shown me how often people will p-hack their data to support their desired outcome.
I’ve met many “data driven” teams that quickly turn their nose up at bad data
Re: ChatGPT generates fake data set to support scientific hypothesis
#19Roughly speaking, the whole point of an LLM is to create plausible sounding text, without regard to the truth (which it cannot determine or derive), so it's a tool that is perfectly suited to this sort of malfeasance.
Re: ChatGPT generates fake data set to support scientific hypothesis
#20>“It will make it very easy for any researcher or group of researchers to create fake measurements on non-existent patients, fake answers to questionnaires or to generate a large data set on animal experiments.” Perhaps I'm naive, but I think the people that want to fake data were already doing it without tools like chatgpt. Especially since a ton of biological data is normally distributed, so it's exceedingly easy t…
[deleted]