Viewing profile — alexpinel

Yes! Of course because the LLM is running locally it is not as advanced as bigger models like Claude or GPT, but you can definately quiz the documents. From my experience it perfor…

Right now the minimum amount of RAM I would recommend is 16gb, I think it can run with less memory but that will require a few changes here and there (although they might reduce pe…

Hi! I'm the guy who made Dot. I remember experimenting with a few different vector stores in the early stages of the project but decided to settle with FAISS. I mainly chose it bec…

With those settings I would recommend GPU. CUDA acceleration really makes it faster, but keep in mind the CUDA toolkit 12.2 install will be a some 3-4gb

thanks! right now it runs on Apple Silicon and Windows, it works far better with a GPU on PC but should also work with CPU if there is enough RAM. Although some people have mention…

Hi! Really happy to see my project being posted around, please feel free to give feedback or ask any questions! :)

Little project I have been working on, Dot is a standalone app that allows users to run an LLM locally and create a custom AI trained with documents.

This free desktop app allows to perform RAG with Mistral 7B fully locally, very simple to use and seems to work well on my M1 Pro mac

Here is a little pet project of mine, it is a standalone electron js app meant to run a packaged version of Mistral 7B with a focus on loading and interacting with docs in a fully …