Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Talk to any ArXiv paper just by changing the URL

github.com

Post reply on HN
Print view View original

61–70 of 78 posts

Re: Show HN: Talk to any ArXiv paper just by changing the URL

#61

Post by __s »

kn100 wrote: post #21
willvarfar wrote: post #18

Will it become normal to paste your OpenAI keys into a website and will it become the new curl-sudo-bash or checking cloud credentials into github?

Interesting thought. I then wondered if perhaps we could introduce some kind of mechanism like a token that is authorized to spend a certain amount, and then wondered if we could take that concept to the extreme and have one key with some money loaded that users could put into websites. it was at this point I realised I'd just invented the credit card.

Azure has SAS tokens which give time limited subpermission access derived from access key

https://learn.microsoft.com/en-us/azure/ai-services/document...

Used it to scope/isolate databases storing backups to a shared storage account

Re: Show HN: Talk to any ArXiv paper just by changing the URL

#62

Post by 3abiton »

addandsubtract wrote: post #57
magicalhippo wrote: post #40

While it certainly seems cool, as with most other AI tools I'm struggling to see how I'd use it. That is, I can't think of anything I'd want to ask. I assume I'm just getting old and have a limited imagination when it comes to these new AI things. Anyone got any good examples on how to effectively use this?

I struggled with the same problem. What's interesting with LLMs, is that they will augment the data in the paper with their general knowledge. So you can talk to them like you would with a colleague or mentor (but without the shame of asking dumb questions).

But are there currently any good local models that can provide good conversation/support of a recent paper? I feel the level of hallucinations will be huge. Even with gpt4 with pdf2text, it tends to hallucinate a lot. And Gpt4 is the best LLM model so far.

Re: Show HN: Talk to any ArXiv paper just by changing the URL

#64

Post by lolinder »

addandsubtract wrote: post #55
chpatrick wrote: post #28

Earlier quoted context omitted.

Probably with https://github.com/BerriAI/litellm

liteLLM looks like a tool that wraps various providers into an OpenAI API format, or is there more to it? What if I'm more interested in the PDF indexing(?) using ollama? Do you know of any tools that allow me to upload/include PDFs in my ollama chats?

There are a bunch of little projects that do this. It's on the roadmap for ollama-webui (but not implemented yet), and Ollama published a guest blog post with a simple implementation that can be cloned and run very easily:

https://ollama.ai/blog/building-llm-powered-web-apps

There's also Cheshire Cat, which is a framework for building chat assistants that use a set of documents as a knowledge base:

https://github.com/cheshire-cat-ai/core

Re: Show HN: Talk to any ArXiv paper just by changing the URL

#65

Post by kordlessagain »

pugio wrote: post #9
skeptrune wrote: post #2

This is the first time I have seen someone use GROBID. It seems like an incredibly cool solution

I've spent the last couple weeks diving into various PDF parsing solutions for scientific documents. GROBID is pretty cool, but it made some mistakes when trying to parse (I think arxiv) papers which removed some of the text. Even though it gave a lot of great structured options, missing even a single sentence was unforgivable to me. I went with Nougat instead, for arxiv papers. (Also check out Marker (mentioned on h…

Google's Document AI does a good job, but I'll need to test the equation handling again to be sure.

Re: Show HN: Talk to any ArXiv paper just by changing the URL

#67

Post by KomoD »

theolivenbaum wrote: post #27
Aachen wrote: post #12

Earlier quoted context omitted.

The oldest instance of it that I know is putting something like download before or after the youtube domain. This must have been 2008±2. I very much doubt that's the first instance ever but I wasn't around online in the 90s (aside from on my grandma's machine who didn't know her computer had a web browser, but that wasn't very conscious, just a neutral net (young me) clicking buttons to see the effect)

ss before youtube.com brings you to a download page (i.e. ssyoutubecom)

or youtube5s

Re: Show HN: Talk to any ArXiv paper just by changing the URL

#68

Post by kordlessagain »

quickthrower2 wrote: post #49

This could be generalized to any url right? With maybe special rules so that you know how to get to the pdf for arxiv.

If you want a generalized version of something similar, try this: https://github.com/MittaAI/mitta-community/tree/main/cookboo...

The query pipeline isn't that sophisticated, but it could be altered to do page reference and use keyterms first to filter, instead of doing the vector similarity on all data.

One thing with MittaAI is that it doesn't do UI interfaces. It expects you to handle those bits.

Post reply on HN