We are doing a Hackathon currently with the exact same idea. What are the chances?
Very high, there are a lot of these. It's not too far from a hello world project.
when will I get over hello world? Gosh
ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
31–40 of 70 posts
Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#32I've tried this and chatpdf with some Computer Aided Geometric Design mathematics theses and papers. These tools do not seem to "read" the math parts of the papers, only the text. It would be amazing to have something which could digest a bunch of papers and start to help me navigate them, but a lot of the answers I get are "I don't have enough context to help you". Is there a better tool or way to use LLMs with scho…
It's not always great, but try explainpaper [1]. I have nothing to do with it, but to me it's the best, they seem to put some real effort on it since day one. [1] explainpaper.com
Comment of the day, this is why I keep checking HN daily.
Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#33How do we know ChatGPT isn't hallucinating parts of its answers? I think this is an interesting service but what are the guardrails so we can trust the answer?
GPT definitely makes mistakes. GPT4 less than GPT3.5, and way less than Bard.
Having spent quite a lot of professional time working through real-world problems with GPT4, I'll say it very rarely does something I'd call hallucination. It almost never invents crazy things out of whole cloth. Sometimes it makes wrong guesses about things.
You gotta keep your own head and be skeptical. Often you can tell if it's coming unhinged. If it makes mistakes and you notice, it'll definitely own them unlike many LLMs. But of course it's not perfect.
Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#34How do we know ChatGPT isn't hallucinating parts of its answers? I think this is an interesting service but what are the guardrails so we can trust the answer?
Hallucinations mainly occur when the prompt does not contain the information required for the completion.
When you add parts of the content of the PDF to the prompt, which is how these tools work, then it is very likely to produce a completion consistent with the PDF.
I say “mainly” and “very likely”, but in my experience I have never had a hallucination when the prompt is augmented with factual data.
Hallucinations occur with regularity when the prompt does not contain what is requested to be completed.
Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#35I've tried this and chatpdf with some Computer Aided Geometric Design mathematics theses and papers. These tools do not seem to "read" the math parts of the papers, only the text. It would be amazing to have something which could digest a bunch of papers and start to help me navigate them, but a lot of the answers I get are "I don't have enough context to help you". Is there a better tool or way to use LLMs with scho…
Yeah it is mediocre. I think the issue is having to first upload/read then push back data. It has not been optimized yet. It needs lot of work. I am not sure which open-source has that capability yet to run it locally. Perhaps that will be faster but I have not played with or explored that area.
Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#36We are doing a Hackathon currently with the exact same idea. What are the chances?
High. Everybody, myself included, had this idea . There's also been (at least 2) posts in the past about similar products. I stopped from testing these out as they all "cheat", or at least in my opinion they cheat, by creating embeddings and vector search before hitting up GPT with the context/answer.
Why do you consider this cheating? The context window is currently too small for it to work in any other manner.
Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#37Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#38Earlier quoted context omitted.
It's not always great, but try explainpaper [1]. I have nothing to do with it, but to me it's the best, they seem to put some real effort on it since day one. [1] explainpaper.com
Comment of the day, this is why I keep checking HN daily.
you're welcome :D
Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#39Earlier quoted context omitted.
High. Everybody, myself included, had this idea . There's also been (at least 2) posts in the past about similar products. I stopped from testing these out as they all "cheat", or at least in my opinion they cheat, by creating embeddings and vector search before hitting up GPT with the context/answer.
Why do you consider this cheating? The context window is currently too small for it to work in any other manner.
You could ask Claude+ 100k to give you the text context(s) containing anything pertinent then have GPT4 prompted with that.
Re: ScholarTurbo: Use ChatGPT to chat with PDFs (supports GPT-4)
#40It's pretty disgusting to see how many of these exist, yet so few are local-only with local LMs.
It's exceedingly obvious that local LMs are desired and far better for this task, and only idiots would be interested in paying for software like this that uses OpenAI.