Show HN: Open-Source DocumentAI with Ollama

I thought about adding an API interface for it. It is on my to-do list of things that could be good to add. For now, I'm gathering feedback to see what people like about it or not.

Re: Show HN: Open-Source DocumentAI with Ollama

#8

Post by foundzen » Sat, Mar 08, 2025, 6:49 AM UTC

What is the architecture/tech-stack used in building this? I didn't find this info neither on github readme, nor on website.

I like the fact that it is written in Go and small enough to skim over the weekend, but after repeatedly burning my time on dozens of llm ecosystem tools, I'm careful in choosing to even explore the code myself without seeing these basic disclosures upfront. I'm sure you'd see more people adopting your tool if you can provide a high-level overview of the project's architecture (ideally in a visual manner)

Re: Show HN: Open-Source DocumentAI with Ollama

#9

Post by car » Sat, Mar 08, 2025, 6:53 AM UTC

Could this work with llama.cpp, since it’s the engine behind Ollama?

I usually build llama.cpp from source and download quantized (GGUF) models from Huggingface, haven’t used Ollama this far.

Re: Show HN: Open-Source DocumentAI with Ollama

#10

Post by Dontizi » Sat, Mar 08, 2025, 7:01 AM UTC

car wrote: post #9

Could this work with llama.cpp, since it’s the engine behind Ollama? I usually build llama.cpp from source and download quantized (GGUF) models from Huggingface, haven’t used Ollama this far.

No, for now, I’ve only made it work with Ollama, but it could be ideal to do it directly on llama.cpp. Thank you, I’ll take note of it.