Live data from Hacker News

ChatGPT generates fake data set to support scientific hypothesis

nature.com

21–30 of 159 posts

Re: ChatGPT generates fake data set to support scientific hypothesis

#21
This is why for domains like science, tools like Elicit are so needed [1].

They've been doing some interesting work on factored cognition to avoid these sort of hallucinations [2].

1: https://elicit.com/ 2: https://blog.elicit.com/factored-verification-detecting-and-...

Re: ChatGPT generates fake data set to support scientific hypothesis

#22
post #16

>“It will make it very easy for any researcher or group of researchers to create fake measurements on non-existent patients, fake answers to questionnaires or to generate a large data set on animal experiments.” Perhaps I'm naive, but I think the people that want to fake data were already doing it without tools like chatgpt. Especially since a ton of biological data is normally distributed, so it's exceedingly easy t…

Exactly. How is this news? What would be surprising is if ChatGPT _could_ generate fake data that passed analysis.

Re: ChatGPT generates fake data set to support scientific hypothesis

#25
Ironically, I tried to ask ChatGPT to generate a signal + some plausibly background for a potential Supersymmetry particle discovery (with some details about model independent searches) and it started hallucinating like someone whose heart broken and spent the night drinking at the bar.

I chose the wrong field to be able to fake data /S.

Re: ChatGPT generates fake data set to support scientific hypothesis

#27
post #16

>“It will make it very easy for any researcher or group of researchers to create fake measurements on non-existent patients, fake answers to questionnaires or to generate a large data set on animal experiments.” Perhaps I'm naive, but I think the people that want to fake data were already doing it without tools like chatgpt. Especially since a ton of biological data is normally distributed, so it's exceedingly easy t…

[flagged]

Re: ChatGPT generates fake data set to support scientific hypothesis

#29
In this instance the ability to generate fake data is seen as negative, however in other realms it’s seen as a feature, rather than a bug.

See:

https://en.wikipedia.org/wiki/Synthetic_data

or in scientific literature:

https://arxiv.org/abs/2208.09191

a few companies are doing exclusively this

Re: ChatGPT generates fake data set to support scientific hypothesis

#30
A long time ago, I ran into the books The Art of Deception and How to Lie With Statistics. They seemed like a good start on training people to spot deceptions. There were articles here on things like p-hacking. Then, the replication crisis.

While no time now, I’m still interested in making a list of resources (esp free) that tells how to construct good studies, has comprehensive presentation of all categories of mistakes/lies we see in them, examples of each, and practice studies with known errors. Anyone here got good books or URL’s that could go in a resource like that? That could train new reviewers quickly?

If I return to AI or ever work in it, I also planned to teach all of that to AI models to automatically review scientific papers. Might contribute to solving the replication crisis. Anyone who’s doing AI now feel free to jump on that. Get a startup or Ph.D. with a tool that tells us which of the rest are fake.

Post reply on HN