Confabulation, folks
ChatGPT generates fake data set to support scientific hypothesis
71–80 of 159 posts
Re: ChatGPT generates fake data set to support scientific hypothesis
#72For anyone jumping in who hasn't read the article, this is not about hallucinations and some researchers being surprised that GPT-4 doesn't always respond with absolute truth. Instead it's about how easily it can be used to generate plausible looking datasets that would confirm a hypothesis. It's a warning note to journals about how fake data can more easily be created.
Confabulation's a better word for this
Re: ChatGPT generates fake data set to support scientific hypothesis
#73[deleted]
Re: ChatGPT generates fake data set to support scientific hypothesis
#74its sad that people write entire research papers about how they are prompting it wrong this stuff is getting old. it doesnt need studies on how an LLM bullshits. nobody needs a study on that, they need an article in a tabloid at best.
At least it wasn’t published in Nature. I was kind of scared when I saw the submitted link.
Re: ChatGPT generates fake data set to support scientific hypothesis
#75>“It will make it very easy for any researcher or group of researchers to create fake measurements on non-existent patients, fake answers to questionnaires or to generate a large data set on animal experiments.” Perhaps I'm naive, but I think the people that want to fake data were already doing it without tools like chatgpt. Especially since a ton of biological data is normally distributed, so it's exceedingly easy t…
So we’re pretending making something an order of magnitude easier makes no difference? Ok.
[deleted]
Re: ChatGPT generates fake data set to support scientific hypothesis
#76Earlier quoted context omitted.
"Humanity learns" is impossible. The unit of analysis is the individual. Some state may cross between individuals via education, but the individuals still must learn. History shows that knowledge transmission remains a sticky wicket.
Firm disagree! Example: take a tour of the tower of London and learn about all the nasty medieval tortures we used to inflict on people. Now we don't do that anymore. Humans learn things collectively via culture and cultural transmission has been an extremely effective tool of knowledge preservation over the generations.
I’ve seen worse in person unfortunately
Re: ChatGPT generates fake data set to support scientific hypothesis
#77Earlier quoted context omitted.
Firm disagree! Example: take a tour of the tower of London and learn about all the nasty medieval tortures we used to inflict on people. Now we don't do that anymore. Humans learn things collectively via culture and cultural transmission has been an extremely effective tool of knowledge preservation over the generations.
Arguably culture has been degrading somewhat lately
This has been the popular narrative in almost all common written history forever. It’s basically the biggest recurring theme in diaries from the Middle Ages, especially among religious text.
Things are never an upward hockey stick but they also aren’t saw waves skirting a baseline.
Re: ChatGPT generates fake data set to support scientific hypothesis
#78As an academic researcher, I find analysis of GPT-4 itself — as it pertains to other fields — to be essentially meaningless. There are no guarantees that the version of the model that was used will be available in the future (the API endpoints seem to have a ~12 month future-looking guarantee at most). Don't get me wrong: 1. GPT-4 is incredibly interesting 2. Studying GPT-4 is interesting for people working in that f…
They're testing a consumer product. They're product testers.
Re: ChatGPT generates fake data set to support scientific hypothesis
#79People will find such dumb reasons to get outraged. Folks have been photoshopping GFP expression for years. Then some halfwit will post it "there's some evidence that X is Y". Try to replicate it, you can't. Because the science is fake.