41–50 of 65 posts
Earlier quoted context omitted.
Yes but they claim it runs on Linux when it runs on Systemd.
What you guys are referring to as Linux, is in fact, GNU/Linux, or as I've recently taken to calling it, GNU plus Linux plus Systemd. Linux is not an operating system unto itself, but rather another free component of a fully functioning GNU system made useful by the GNU corelibs, shell utilities, and vital system components comprising a full OS as defined by POSIX.Many computer users run a modified version of the GNU…
I have been building some stuff on top of the OpenAi interface (to use their store) but find myself wanting to implement some simple UI elements (like a date selected or a simple dashboard).
So I feel like these types of apps have a few re occurring elements:
1. A chat interface „frontend“ (with threads, interfaces to popular APIs or local models) nice Ui ideally extensibility to some custom UI elements authentication etc.
2. API calls. (E.g. like OpenAI actions) Simplest case just reading and writing to a db (simple crud).
3. Local data + RAG. With a custom retrieval/search logic could be embeddings or simpler search methods.
Do you know open source software for all three elements? Of course you can piece it together and maybe this is the best approach. But maybe you could build something integrated.
How do you get value from chatting with documents? I can scan and read a pdf faster than I can chat with an AI about it. There must be more to it than I realize.
a one-page PDF, sure. But if it's a 500 page pdf of a law and/or regulation, then definitely not.
Basically it makes no sense to “chat” with a 500 page pdf with todays LLMs.
Earlier quoted context omitted.
this doesn’t work on Nix, pls fix
I also use NixOS, but if the target was not NixOS, I don't think you should be requesting the set up as needing fixing by the author. It just doesn't sound right - or maybe it is just me. NixOS isn't the defacto standard, and breaks the Linux FHS to achieve all the good stuff it does do. Either try to package it or use a docker image or maybe raise an issue noting the blocker and request it as a feature for some chan…
I see many of my friends building some kind of RAG system with chat interface. I have been building some stuff on top of the OpenAi interface (to use their store) but find myself wanting to implement some simple UI elements (like a date selected or a simple dashboard). So I feel like these types of apps have a few re occurring elements: 1. A chat interface „frontend“ (with threads, interfaces to popular APIs or local…
Earlier quoted context omitted.
a one-page PDF, sure. But if it's a 500 page pdf of a law and/or regulation, then definitely not.
How can you chat with a pdf which doesn’t fit in the context window? I mean with a 500 page pdf you might need 100 context windows to fully grok it. Basically it makes no sense to “chat” with a 500 page pdf with todays LLMs.
So yeah it's kinda smoke and mirrors. In some cases, for some long PDFs, it works really well. If it's a 500 page PDF with many disparate topics, it may do fine.
Great job. This is a relatively crowded area, particularly RAG style chat systems. It might be nice for SecureAI to call out what makes their product different from other open source players in the same space, specifically Khoj and Danswer, both of which allow you to chat with your documents, offer network authentication, and allow you to plug in your own LLM. Danswer https://github.com/danswer-ai/danswer Khoj https:…
Can a directory of PDFs be queried or does it only support a single document?
We plan to make this indexing process offline, where you can create a document collection based on either a directory upload or an integrated data source like Google Drive, Notion, Confluence, etc. Then the system would start indexing that collection in the background and notify you once indexing is complete. Once a collection is indexed, users can select it when creating a new chat and query against it.
Let us know if you have any thoughts on this proposed solution.
I see many of my friends building some kind of RAG system with chat interface. I have been building some stuff on top of the OpenAi interface (to use their store) but find myself wanting to implement some simple UI elements (like a date selected or a simple dashboard). So I feel like these types of apps have a few re occurring elements: 1. A chat interface „frontend“ (with threads, interfaces to popular APIs or local…
We have briefly discussed an approach where we make some of these common elements available as abstractions and let people build "apps" on top of it. It would operate kind of similar to how Google's app store does in that the head use cases (email, photos, camera, etc) are first-party apps, but then anyone can build and publish a third-party app using the Android SDK.