I got "not enough relevant results" in one of the most researched questions in my sub-field. That's a touch disappointing.
Consensus: Use AI to find insights in research papers
41–50 of 54 posts
Re: Consensus: Use AI to find insights in research papers
#42Earlier quoted context omitted.
FWIW is is pretty common to read the abstract, skim the intro, skip to the conclusion/results, and then only then read the rest of the paper (if you even need to at that point). https://www.science.org/content/article/how-seriously-read-s... So, this is pretty quick, you might not need a tool for it.
Actually, what I was asking about was how to handle my storage and later retrieval of hundreds of papers. I don't mean just the database tool -- I currently use Zotero and make sure articles are tagged -- but I'm wondering if I can build a system for my articles where I can ask ChatGPT "are there any studies that show X causes Y" and have it use my articles directly, and not give me bullshit citations like it does 90…
Litmap is a good surfacer of related papers if you have a starting seed to work from
Re: Consensus: Use AI to find insights in research papers
#43Earlier quoted context omitted.
Elicit is very useful! It can't sometimes answer some very specific and complex questions, but it also doesn't tend to hallucinate anywhere as much as chatgpt. Rather it will be quite upfront about when it can't really find an answer to something.
From which database are the papers that it searches?
According to the FAQ [1] the source is the "Semantic Scholar Academic Graph dataset".
Re: Consensus: Use AI to find insights in research papers
#44Earlier quoted context omitted.
Every time I hear or read "prompt engineering", I can't help but cringe a bit. I'm not sure why, but it's the same reaction I would have if I heard someone say "Google search query engineering". Comparing to google search, there definitely is skill involved in knowing how to google things well. We're all accustomed to googling things many times per day so I think a lot of people forget that being able to google thing…
IMO you're right that "prompt engineering" is a cringe-y term because it implies what you're doing is mostly writing prompts. That being said, I don't think that's what it actually entails, any more than "backend engineering" is mostly writing SQL queries. Prompt engineering is building the systems around the prompts e.g. writing the LangChain or whatever code, parsing stuff and interacting with structured DBs, messa…
This is a great recap of the present role. I have been following a conversation around the AI Engineer as a label (although I like Applied AI better) from the Latent Space podcast team so a fair amount of meme hypecycle, but also active and actionable. They are setting up a conference in October and you can see the discussion unfold around the blog post below on X-itter.
Re: Consensus: Use AI to find insights in research papers
#45I've been doing this with chatGPT directly. But it's cutoff data is 2021. It's pretty good though at telling you even the research name so you can validate.
As someone who is starting a master's in science and will be looking at lots of research papers, I've been wondering what the best use of this could be. If I have my own PDFs, I guess I could get ChatGPT to create summaries in some structured way, perhaps in a single file with citation:summary, and then send up that file with every question I ask?
Some article today (in spiegel) suggested these tools for pdf upload and various levels of support when extracting information from papers and writing new papers:
* https://www.explainpaper.com/
Do any of you have any experience with these tools? Jenni ai seems interesting for doing research/thesis style work.
Re: Consensus: Use AI to find insights in research papers
#46I think https://elicit.org/ is also worth a mention in this context.
I actually think it would make sense for Consensus to try to highlight how they are different than e.g. Elicit, since they already exist on the market since quite some time.
Re: Consensus: Use AI to find insights in research papers
#47It just occurred to me recently that AI could and should be set up to replace peer reviews of scientific papers. (See the book "Science Fictions"). I asked ChatGPT v3.5 what it would take to do exactly that and what the algorithm would look like. I was very impressed with the response.
Looking further down the road, if we connect AI to reality to any significant degree and train it to be completely objective, the powers-that-be will ban it. After all, they have their narratives to push and their propaganda to spew. I no longer ask myself why the conventional wisdom is so often wrong.
Re: Consensus: Use AI to find insights in research papers
#48Re: Consensus: Use AI to find insights in research papers
#49Earlier quoted context omitted.
As someone who is starting a master's in science and will be looking at lots of research papers, I've been wondering what the best use of this could be. If I have my own PDFs, I guess I could get ChatGPT to create summaries in some structured way, perhaps in a single file with citation:summary, and then send up that file with every question I ask?
Some article today (in spiegel) suggested these tools for pdf upload and various levels of support when extracting information from papers and writing new papers: * https://jenni.ai/ * https://www.explainpaper.com/ * https://www.chatpdf.com/ * https://typeset.io/ Do any of you have any experience with these tools? Jenni ai seems interesting for doing research/thesis style work.
> jenni ai seems interesting for doing research/thesis style work.
“Join the Jenni influencer program and earn money for your posts. Earn up to $5,000 per post. We'll send you $1 for every 1,000 views your post receives. Minimum payout $20 (20k views).” — https://jenni.ai/influencer-program
Sounds very interesting to say it sounds interesting.
Re: Consensus: Use AI to find insights in research papers
#50Earlier quoted context omitted.
Some article today (in spiegel) suggested these tools for pdf upload and various levels of support when extracting information from papers and writing new papers: * https://jenni.ai/ * https://www.explainpaper.com/ * https://www.chatpdf.com/ * https://typeset.io/ Do any of you have any experience with these tools? Jenni ai seems interesting for doing research/thesis style work.
> jenni ai seems interesting for doing research/thesis style work. “Join the Jenni influencer program and earn money for your posts. Earn up to $5,000 per post. We'll send you $1 for every 1,000 views your post receives. Minimum payout $20 (20k views).” — https://jenni.ai/influencer-program Sounds very interesting to say it sounds interesting.
I think I would even be interested in what somebody has to say here about these services, even if they get paid for it.