Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: Is using AI tooling for a PhD literature review dishonest?

news.ycombinator.com

Post reply on HN
Print view View original

11–20 of 36 posts

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#11

Post by BrenBarn »

austinjp wrote: post #10

While your dashboard sounds fancy, this part raises issues: > I run ChatGPT Pro to collect all relevant papers Any literature review must be reproducible. If you can't say exactly what queries you ran against exactly what databases, you'll get into trouble. Whether or not that's the way things should be is irrelevant: it's the way things are. You should ask your supervisor if your approach is okay. If necessary, ask…

> Any literature review must be reproducible.

That's totally at odds with my understanding, but perhaps this differs between fields.

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#12

Post by malshe »

I don't think what you are doing is dishonest. But my opinion hardly matters.

My advice is to talk to your dissertation committee chair to understand whether they think it is dishonest. Furthermore, read your university's AI usage policies. If they don't consider what you are doing a permissible use of AI, no amount of assurance on HN or any online forum is gonna help you.

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#13

Post by latand6 »

jimbooonooo wrote: post #9
love2read wrote: post #2

Someone against AI will tell you yes, someone for AI will tell you no. The only thing I can really say is that saying you have ADHD so you should have a reprieve from the normal rules is something that I don't agree with.

I was diagnosed later in life with ADHD and struggled academically, but agree with this completely. Everybody faces difficulties in life, and ADHD doesn't justify constant exceptions. Your workplace will be far less accommodating, and you need to figure out how to adapt. Using AI for literature review is a great tool, but I think the onus is on you to to both verify the output, AND disclose usage of said tool. Clearl…

I’d be happy to disclose and even consider to share how I did it all

I’ve even drafted the acknowledgment part with brief explanation of how I used AI tools

The only part I’m concerned about is the stigma around the AI use and that it can be treated as misconduct

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#14

Post by latand6 »

austinjp wrote: post #10

While your dashboard sounds fancy, this part raises issues: > I run ChatGPT Pro to collect all relevant papers Any literature review must be reproducible. If you can't say exactly what queries you ran against exactly what databases, you'll get into trouble. Whether or not that's the way things should be is irrelevant: it's the way things are. You should ask your supervisor if your approach is okay. If necessary, ask…

Can you really reproduce it though?

I thought it’s the experiments that have to be able to reproduce, not the literature review

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#15

Post by latand6 »

malshe wrote: post #12

I don't think what you are doing is dishonest. But my opinion hardly matters. My advice is to talk to your dissertation committee chair to understand whether they think it is dishonest. Furthermore, read your university's AI usage policies. If they don't consider what you are doing a permissible use of AI, no amount of assurance on HN or any online forum is gonna help you.

I agree with you and that’s exactly what I’m going to do. It’s just that I may be more persuasive if I’m prepared

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#16

Post by latand6 »

bjourne wrote: post #8

You cannot copy others' work and claim it is your own. Thus, you cannot copy ChatGPT's work and claim it is your own. There is a qualitative difference between having an LLM generate text and having a program spell- and grammar check text. Since you are not going to highlight which passages in your article ChatGPT wrote for you and instead intend to pass it of as your own creative work it is dishonest. Very dishonest…

There is not a single paragraph that I might “steal” from ChatGPT. I’m consistently using multiple LLMs to write, polish, rephrase and all other kinds of edits

I really don’t get the point of the necessity of typing manually. Can you explain?

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#17

Post by latand6 »

fyredge wrote: post #5

Yes and no. The first thing to understand is that in academia, knowledge is the work. You are being trained to absorb existing knowledge, hypothesise new knowledge and test if it is valid. LLMs are a useful tool if you want it to generate text. But in the context of research, this is quite dangerous. Think of a calculator that spits out the wrong answer 10% of the time, would you trust it to use in an exam? How about…

Yeah that’s exactly my point. The AI is just taking the boring job of collecting evidence and I’m a validator. This way i see that I’m able to process papers much faster than without AI. It’s faster primarily because you don’t have to spend 70% of your time reading abstracts and sections of the papers you’ll never need. Doing manually it’s very exhausting.

Thats being said, I feel like I’m feeling more productive it terms of generating insights apart from what the AI said. I also have a chat interface where I basically can ask anything I want from the PDF (and yeah I’m aware of the NotebookLM, I just don’t trust Gemini)

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#18

Post by austinjp »

BrenBarn wrote: post #11
austinjp wrote: post #10

While your dashboard sounds fancy, this part raises issues: > I run ChatGPT Pro to collect all relevant papers Any literature review must be reproducible. If you can't say exactly what queries you ran against exactly what databases, you'll get into trouble. Whether or not that's the way things should be is irrelevant: it's the way things are. You should ask your supervisor if your approach is okay. If necessary, ask…

> Any literature review must be reproducible. That's totally at odds with my understanding, but perhaps this differs between fields.

Quite probably there are differences between fields. In biomedical literature reviews the search terms and databases are detailed, and (in systematic reviews) a PRISMA flowchart [0] provided. The theory being that other researchers could repeat the searches and the in/out decisions and get the same stack of papers to review.

[0] https://www.prisma-statement.org/prisma-2020-flow-diagram

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#19

Post by austinjp »

latand6 wrote: post #14
austinjp wrote: post #10

While your dashboard sounds fancy, this part raises issues: > I run ChatGPT Pro to collect all relevant papers Any literature review must be reproducible. If you can't say exactly what queries you ran against exactly what databases, you'll get into trouble. Whether or not that's the way things should be is irrelevant: it's the way things are. You should ask your supervisor if your approach is okay. If necessary, ask…

Can you really reproduce it though? I thought it’s the experiments that have to be able to reproduce, not the literature review

Whether you can or can't in reality is moot, unfortunately. The literature search in biomedical fields should indeed be theoretically reproducible. I don't know about other fields, but it would seem odd to me if a search was not reproducible, that would lead to a very arbitrary literature selection.

As for the experiments, yes, in experimental fields. But in all (most?) fields, including non-experimental, the whole process should be well documented so it could be reproduced end-to-end if possible. If it's not reproducible there should be good, well explained reasons why not.

Note that reproduciblity does not necessarily mean the exact same answer will definitely emerge, just that the methods can be followed closely.

Re: Ask HN: Is using AI tooling for a PhD literature review dishonest?

#20

Post by matzalazar »

Think about it this way: 70 years ago, would a physicist be considered a cheater for using a calculator to solve complex differential equations in their daily work? People tend to frame the moral dilemmas of new technology through the lens of everyday human tasks, and I think that's just a prejudice.
Post reply on HN