Regarding PrivateGPT, if I have a 12GB Nvidia 4070 and an 11GB 2080ti, which LLM should I run? Edited to add: https://www.choosellm.com/ by the PrivateGPT folks seems to have what I needed.
MemoryCache: Augmenting local AI with browser data
11–20 of 108 posts
Re: MemoryCache: Augmenting local AI with browser data
#12Re: MemoryCache: Augmenting local AI with browser data
#13I would sure love a way to "chat" with my browsing history and page content. Is there any way to automatically save off pages that I've visited for later processing? I looked a decade or more ago and didn't really find a good solution.
Re: MemoryCache: Augmenting local AI with browser data
#14I'm confused by the example they gave. > What is the meaning of a life well-lived? Is the response to this based on browser data? Based on the description I was expecting queries more like: > What was the name of that pdf I downloaded yesterday? > What are my top 3 most visited sites? > What type of content do I generally interact with?
Re: MemoryCache: Augmenting local AI with browser data
#15What I would love to see is this model being able to learn ti automate some tasks that I usually do! e.g. sign up for events/buy tickets etc! If this has access to your login details, and could log in, it could be a great assistant!
Re: MemoryCache: Augmenting local AI with browser data
#16Re: MemoryCache: Augmenting local AI with browser data
#17I would sure love a way to "chat" with my browsing history and page content. Is there any way to automatically save off pages that I've visited for later processing? I looked a decade or more ago and didn't really find a good solution.
Re: MemoryCache: Augmenting local AI with browser data
#18Was just talking about this on reddit like two days ago Instead of data going to models, we need models come to our data which is stored locally and stay locally. While there are many OSS for Loading personal data, they dont do images or videos. In the future everyone may get their own Model but for now tech is there but product/OSS is missing for everyone to get their own QLORA or RAG or Summarizer. Not just message…
Re: MemoryCache: Augmenting local AI with browser data
#19Was just talking about this on reddit like two days ago Instead of data going to models, we need models come to our data which is stored locally and stay locally. While there are many OSS for Loading personal data, they dont do images or videos. In the future everyone may get their own Model but for now tech is there but product/OSS is missing for everyone to get their own QLORA or RAG or Summarizer. Not just message…
I assume that training LLMs locally require high-end hardware. Even running a model requires a decent CPU or, even better, a high end GPU, but it is not so expensive as training a model. And usually you have to use hardware that is available on the cloud, so not much of privacy here.
Re: MemoryCache: Augmenting local AI with browser data
#20I hope this encourages Mozilla to focus more on page archiving support on the web. I feel as though they missed a huge opportunity by not making it easy to archive pages with DOM snapshots, or easy to snag videos or images. (Go to Instagram and try to right-click -> download the image; you can't.) Would have been a very good way to differentiate from Chrome, as Google wouldn't want that available for Youtube. And "ou…