Live data from Hacker News

MemoryCache: Augmenting local AI with browser data

future.mozilla.org

11–20 of 108 posts

Re: MemoryCache: Augmenting local AI with browser data

#11

Regarding PrivateGPT, if I have a 12GB Nvidia 4070 and an 11GB 2080ti, which LLM should I run? Edited to add: https://www.choosellm.com/ by the PrivateGPT folks seems to have what I needed.

There's a big community discussing exactly that over at https://www.reddit.com/r/LocalLLaMA/.

Re: MemoryCache: Augmenting local AI with browser data

#13

I would sure love a way to "chat" with my browsing history and page content. Is there any way to automatically save off pages that I've visited for later processing? I looked a decade or more ago and didn't really find a good solution.

Rewind.ai is pretty much this - I just installed it and am very happy so far.

Re: MemoryCache: Augmenting local AI with browser data

#14

I'm confused by the example they gave. > What is the meaning of a life well-lived? Is the response to this based on browser data? Based on the description I was expecting queries more like: > What was the name of that pdf I downloaded yesterday? > What are my top 3 most visited sites? > What type of content do I generally interact with?

[deleted]

Re: MemoryCache: Augmenting local AI with browser data

#15
post #12

What I would love to see is this model being able to learn ti automate some tasks that I usually do! e.g. sign up for events/buy tickets etc! If this has access to your login details, and could log in, it could be a great assistant!

Or shoe bot

Re: MemoryCache: Augmenting local AI with browser data

#16
I hope this encourages Mozilla to focus more on page archiving support on the web. I feel as though they missed a huge opportunity by not making it easy to archive pages with DOM snapshots, or easy to snag videos or images. (Go to Instagram and try to right-click -> download the image; you can't.) Would have been a very good way to differentiate from Chrome, as Google wouldn't want that available for Youtube. And "our browser can download videos and images from anywhere" is pretty easy to sell for potential users.

Re: MemoryCache: Augmenting local AI with browser data

#17

I would sure love a way to "chat" with my browsing history and page content. Is there any way to automatically save off pages that I've visited for later processing? I looked a decade or more ago and didn't really find a good solution.

I think WorldBrain (https://github.com/WorldBrain/Memex) promises this. While I'm also excited by the idea, I think there was some reason I ended up not using it.

Re: MemoryCache: Augmenting local AI with browser data

#18

Was just talking about this on reddit like two days ago Instead of data going to models, we need models come to our data which is stored locally and stay locally. While there are many OSS for Loading personal data, they dont do images or videos. In the future everyone may get their own Model but for now tech is there but product/OSS is missing for everyone to get their own QLORA or RAG or Summarizer. Not just message…

I assume that training LLMs locally require high-end hardware. Even running a model requires a decent CPU or, even better, a high end GPU, but it is not so expensive as training a model. And usually you have to use hardware that is available on the cloud, so not much of privacy here.

Re: MemoryCache: Augmenting local AI with browser data

#19
post #18

Was just talking about this on reddit like two days ago Instead of data going to models, we need models come to our data which is stored locally and stay locally. While there are many OSS for Loading personal data, they dont do images or videos. In the future everyone may get their own Model but for now tech is there but product/OSS is missing for everyone to get their own QLORA or RAG or Summarizer. Not just message…

I assume that training LLMs locally require high-end hardware. Even running a model requires a decent CPU or, even better, a high end GPU, but it is not so expensive as training a model. And usually you have to use hardware that is available on the cloud, so not much of privacy here.

You don't need to train the model on your data: you can use retrieval augmented generation to add the relevant documents to your prompt at query time.

Re: MemoryCache: Augmenting local AI with browser data

#20
post #16

I hope this encourages Mozilla to focus more on page archiving support on the web. I feel as though they missed a huge opportunity by not making it easy to archive pages with DOM snapshots, or easy to snag videos or images. (Go to Instagram and try to right-click -> download the image; you can't.) Would have been a very good way to differentiate from Chrome, as Google wouldn't want that available for Youtube. And "ou…

Agree, it seems like it’s insanely hard to back up a modern JS-enabled web page in a usable way that results in a single file which can be easily shared.
Post reply on HN