Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Open-Source DocumentAI with Ollama

rlama.dev

Post reply on HN
Print view View original

11–20 of 39 posts

Re: Show HN: Open-Source DocumentAI with Ollama

#11

Post by Dontizi »

foundzen wrote: post #8

What is the architecture/tech-stack used in building this? I didn't find this info neither on github readme, nor on website. I like the fact that it is written in Go and small enough to skim over the weekend, but after repeatedly burning my time on dozens of llm ecosystem tools, I'm careful in choosing to even explore the code myself without seeing these basic disclosures upfront. I'm sure you'd see more people adopt…

Hey! Yes, that's something I was planning to do—a complete documentation on the code, its architecture, and the entire stack to allow others to develop alongside me. I just deployed a functional version, and soon, the website will have documentation with its architecture and a visualization of the entire code.

but for now here is the stack used: Core Language: Go (chosen for performance, cross-platform compatibility, and single binary distribution) CLI Framework: Cobra (for command-line interface structure) LLM Integration: Ollama API (for embeddings and completions) Storage: Local filesystem-based storage (JSON files for simplicity and portability) Vector Search: Custom implementation of cosine similarity for embedding retrieval

Re: Show HN: Open-Source DocumentAI with Ollama

#12

Post by dcreater »

Dontizi wrote: post #11
foundzen wrote: post #8

What is the architecture/tech-stack used in building this? I didn't find this info neither on github readme, nor on website. I like the fact that it is written in Go and small enough to skim over the weekend, but after repeatedly burning my time on dozens of llm ecosystem tools, I'm careful in choosing to even explore the code myself without seeing these basic disclosures upfront. I'm sure you'd see more people adopt…

Hey! Yes, that's something I was planning to do—a complete documentation on the code, its architecture, and the entire stack to allow others to develop alongside me. I just deployed a functional version, and soon, the website will have documentation with its architecture and a visualization of the entire code. but for now here is the stack used: Core Language: Go (chosen for performance, cross-platform compatibility,…

Why not use an established open source vector db like pg_vector etc? I imagine your implementation is not going to be as performant

Re: Show HN: Open-Source DocumentAI with Ollama

#13

Post by TheNicholasNick »

This is cool and pretty much what I was wondering about, I mean obvious it was possible, cool to see it implemented. Looking forward to having a play.

I am building a tool purely with AI and been working on specs and designs. It is clear that Claude and Grok can’t really keep up with the context that we humans can jump around all over the place. Being able to build this local documentation repo and Q&A it will be neat.

Re: Show HN: Open-Source DocumentAI with Ollama

#14

Post by Xiol32 »

dcreater wrote: post #12
Dontizi wrote: post #11

Earlier quoted context omitted.

Hey! Yes, that's something I was planning to do—a complete documentation on the code, its architecture, and the entire stack to allow others to develop alongside me. I just deployed a functional version, and soon, the website will have documentation with its architecture and a visualization of the entire code. but for now here is the stack used: Core Language: Go (chosen for performance, cross-platform compatibility,…

Why not use an established open source vector db like pg_vector etc? I imagine your implementation is not going to be as performant

Defeats the point of the single binary installation if you have to set up dependencies.

Re: Show HN: Open-Source DocumentAI with Ollama

#15

Post by car »

Dontizi wrote: post #10
car wrote: post #9

Could this work with llama.cpp, since it’s the engine behind Ollama? I usually build llama.cpp from source and download quantized (GGUF) models from Huggingface, haven’t used Ollama this far.

No, for now, I’ve only made it work with Ollama, but it could be ideal to do it directly on llama.cpp. Thank you, I’ll take note of it.

That would be great. Llama.cpp’s built in server offers HTTP embedding endpoints.

Re: Show HN: Open-Source DocumentAI with Ollama

#17

Post by Dontizi »

sorokod wrote: post #16

Would be interesting to see an example session of a user interacting with rlama. Maybe a Q&A about it's own Go code.

I've already made some examples, even with my own codebase, to see how it can be used to understand projects, and I want to show how it can be used with documentation or studies. I will publish them next week.

Re: Show HN: Open-Source DocumentAI with Ollama

#19

Post by mentalgear »

dcreater wrote: post #12
Dontizi wrote: post #11

Earlier quoted context omitted.

Hey! Yes, that's something I was planning to do—a complete documentation on the code, its architecture, and the entire stack to allow others to develop alongside me. I just deployed a functional version, and soon, the website will have documentation with its architecture and a visualization of the entire code. but for now here is the stack used: Core Language: Go (chosen for performance, cross-platform compatibility,…

Why not use an established open source vector db like pg_vector etc? I imagine your implementation is not going to be as performant

I recommend using this hybrid vector/full text search engine that works across many runtimes: https://github.com/oramasearch/orama
Post reply on HN