Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

github.com

Post reply on HN
Print view View original

1–10 of 65 posts

Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

#1

Post by d7y »

Hey everyone,

We have been building SecureAI Tools -- an open-source application layer for ChatGPT and ChatPDF-like AI tools.

It works with locally running LLMs as well as with OpenAI-compatible APIs. For local LLMs, it supports Ollama which supports all the gguf/ggml models.

Currently, it has two features: Chat-with-LLM, and Chat-with-PDFs. It is optimized for self-hosting use cases and comes with basic user management features.

Here are some quick demos:

  * Chat with documents using OpenAI's GPT3.5 model: https://www.youtube.com/watch?v=Br2D3G9O47s
  * Chat with documents using a locally running Mistral model (M2 MacBook): https://www.youtube.com/watch?v=UvRHL6f_w74
Hope you all like it :)

Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools
github.com

Re: Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

#3

Post by cheema33 »

I am very new to this field, so forgive my ignorance when I ask super basic questions.

1. Does chat-with-pdfs function work with scanned PDFs? 2. In the video example for chat-with-pdfs you show uploading a document interactively. The part of processing is quite slow. Can the tool be fed these documents offline as well?

My use case for each user, there are many, to have their own list of documents that they upload. They come back later, after the LLM has had a chance to process all documents and can ask questions about their own documents only.

Is something like this possible?

Re: Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

#4

Post by d7y »

cheema33 wrote: post #3

I am very new to this field, so forgive my ignorance when I ask super basic questions. 1. Does chat-with-pdfs function work with scanned PDFs? 2. In the video example for chat-with-pdfs you show uploading a document interactively. The part of processing is quite slow. Can the tool be fed these documents offline as well? My use case for each user, there are many, to have their own list of documents that they upload. T…

Great questions.

> 1. Does chat-with-pdfs function work with scanned PDFs?

Not yet. We don't do OCR or anything to extract text from images yet. But that would be an awesome feature, so we would love to add it in the future.

> 2. In the video example for chat-with-pdfs you show uploading a document interactively. The part of processing is quite slow. Can the tool be fed these documents offline as well?

Not as of right now. But we do have plans to make that an offline/background job so that we can feed a larger corpus of documents into it and query against it later.

Re: Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

#5

Post by vunderba »

Great job. This is a relatively crowded area, particularly RAG style chat systems. It might be nice for SecureAI to call out what makes their product different from other open source players in the same space, specifically Khoj and Danswer, both of which allow you to chat with your documents, offer network authentication, and allow you to plug in your own LLM.

Danswer

https://github.com/danswer-ai/danswer

Khoj

https://github.com/khoj-ai/khoj

Re: Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

#7

Post by Reptur »

abnry wrote: post #6

Is there a good ML tool for renaming PDFs? There are some tools out there but they assume a journal format.

I tend to just select all the files and then paste their filenames into a Chat AI and tell it to write mv commands to rename them however I need. May be more complicated if you need it to open the PDF to get content for the rename though.

Re: Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

#8

Post by d7y »

abnry wrote: post #6

Is there a good ML tool for renaming PDFs? There are some tools out there but they assume a journal format.

> renaming PDFs

Sorry, I didn't understand. Why do you need ML tool for renaming PDFs? or did you mean rephrasing or rewriting in a different format?

Re: Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

#9

Post by mattsan »

d7y wrote: post #8
abnry wrote: post #6

Is there a good ML tool for renaming PDFs? There are some tools out there but they assume a journal format.

> renaming PDFs Sorry, I didn't understand. Why do you need ML tool for renaming PDFs? or did you mean rephrasing or rewriting in a different format?

Maybe they mean walking a file tree and cleaning up file names to match the titles on the covers of them more accurately?

Re: Show HN: Open source alternative to ChatGPT and ChatPDF-like AI tools

#10

Post by smeej »

d7y wrote: post #4
cheema33 wrote: post #3

I am very new to this field, so forgive my ignorance when I ask super basic questions. 1. Does chat-with-pdfs function work with scanned PDFs? 2. In the video example for chat-with-pdfs you show uploading a document interactively. The part of processing is quite slow. Can the tool be fed these documents offline as well? My use case for each user, there are many, to have their own list of documents that they upload. T…

Great questions. > 1. Does chat-with-pdfs function work with scanned PDFs? Not yet. We don't do OCR or anything to extract text from images yet. But that would be an awesome feature, so we would love to add it in the future. > 2. In the video example for chat-with-pdfs you show uploading a document interactively. The part of processing is quite slow. Can the tool be fed these documents offline as well? Not as of righ…

If I've already run OCR on my PDFs and that's added now as an invisible layer, would it work then?

I've had a workflow digitizing my incoming paper documents, running OCR, and tagging them, all locally, and it would be great to have an easy front-end to talk to them.

Post reply on HN