Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MemoryCache: Augmenting local AI with browser data

future.mozilla.org

Post reply on HN
Print view View original

91–100 of 108 posts

Re: MemoryCache: Augmenting local AI with browser data

#91

Post by mcbits »

nullc wrote: post #83
lofaszvanitt wrote: post #68

Earlier quoted context omitted.

Yeah, but maybe, if you are constantly losing market share... maybe you should work on things that appeals to a wider audience. Except if you have a trump card and intend to use it as a deus ex machina to suddenly show people you are THE browser, the way forward.

You don't gain market share by doing the same stuff the other FREE alternative does. You gain market share by doing what they refused to do, no matter how much it's in the user's interest, because their business is stealing the user's data and yours isn't.

In a just world, that's a way to gain market share. In our world, people concede their data for marginal improvements in the quality of a feature because they can't conceive of how giving up control of their data could come back to harm them. It doesn't feel like there is a downside.

Re: MemoryCache: Augmenting local AI with browser data

#92

Post by lofaszvanitt »

nullc wrote: post #83
lofaszvanitt wrote: post #68

Earlier quoted context omitted.

Yeah, but maybe, if you are constantly losing market share... maybe you should work on things that appeals to a wider audience. Except if you have a trump card and intend to use it as a deus ex machina to suddenly show people you are THE browser, the way forward.

You don't gain market share by doing the same stuff the other FREE alternative does. You gain market share by doing what they refused to do, no matter how much it's in the user's interest, because their business is stealing the user's data and yours isn't.

What free alternatives? All the browsers look & feel the same. Zero innovation.

Re: MemoryCache: Augmenting local AI with browser data

#93

Post by conradev »

herval wrote: post #73
conradev wrote: post #63

Earlier quoted context omitted.

> Instead of data going to models, we need models come to our data which is stored locally and stay locally. We are building this over at https://software.inc ! We collect data about you (from your computer and the internet) into a local database and then teach models how to use it. The models can either be local or cloud-based, and we can route requests based on the sensitivity of the data or the capabilities needed…

site's pretty funny, but would likely be more useful with more information and less clicking-around-nostalgia 8-)

Here is the website with the same information and the same clicking around but less nostalgia: https://software.inc/html

I don’t think it is more useful, but it is certainly more functional (supports screen reading, text selection, maybe dark mode, etc)

Re: MemoryCache: Augmenting local AI with browser data

#94

Post by dr_kiszonka »

smcleod wrote: post #65
SkyMarshal wrote: post #11

Earlier quoted context omitted.

There's a big community discussing exactly that over at https://www.reddit.com/r/LocalLLaMA/ .

+1 r/localllama, 23GB should allow you to run 30b~ models, but honestly some of the new smaller models such as Mistral & friends (Zephyr etc..) are really interesting. You could also Give Mixtral a try if you get a low quant format such as this q3 - https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-G...

Do you know if there is a website or spreadsheet where I could enter my RAM, GPU, etc. and see what models I could run locally?

Re: MemoryCache: Augmenting local AI with browser data

#95

Post by SkyMarshal »

dr_kiszonka wrote: post #94
smcleod wrote: post #65

Earlier quoted context omitted.

+1 r/localllama, 23GB should allow you to run 30b~ models, but honestly some of the new smaller models such as Mistral & friends (Zephyr etc..) are really interesting. You could also Give Mixtral a try if you get a low quant format such as this q3 - https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-G...

Do you know if there is a website or spreadsheet where I could enter my RAM, GPU, etc. and see what models I could run locally?

Yes, https://www.reddit.com/r/LocalLLaMA/. Just ask there and a bunch of Non-Artificial Intelligent agents will give you that answer ;).

Re: MemoryCache: Augmenting local AI with browser data

#96

Post by dralley »

jml7c5 wrote: post #16

I hope this encourages Mozilla to focus more on page archiving support on the web. I feel as though they missed a huge opportunity by not making it easy to archive pages with DOM snapshots, or easy to snag videos or images. (Go to Instagram and try to right-click -> download the image; you can't.) Would have been a very good way to differentiate from Chrome, as Google wouldn't want that available for Youtube. And "ou…

Isn't that basically Pocket, the service that people complain about endlessly as "bloat"?

Re: MemoryCache: Augmenting local AI with browser data

#97

Post by conradev »

voakbasda wrote: post #72
gardenhedge wrote: post #69

Earlier quoted context omitted.

Wow, nice domain. I'd work there for the name alone haha.

Am I cynical thinking the opposite? I can’t imagine they got that domain for a song. Spending a pile of cash on vanity such as that is a real turn off for me; it signals more flash than bang. Am I wrong to think this?

You are not wrong to think this – spending a pile of cash on a name is a big decision that you want to approach with rigor.

We didn't do that, though. Our domain was available for like $4,000. The .inc TLD is intentionally expensive to discourage domain squatting :-)

Re: MemoryCache: Augmenting local AI with browser data

#98

Post by unstuck3958 »

dr_kiszonka wrote: post #94
smcleod wrote: post #65

Earlier quoted context omitted.

+1 r/localllama, 23GB should allow you to run 30b~ models, but honestly some of the new smaller models such as Mistral & friends (Zephyr etc..) are really interesting. You could also Give Mixtral a try if you get a low quant format such as this q3 - https://huggingface.co/TheBloke/Mixtral-8x7B-Instruct-v0.1-G...

Do you know if there is a website or spreadsheet where I could enter my RAM, GPU, etc. and see what models I could run locally?

While I agree a website/spreadsheet would be convenient, it's not that complicated. As long as GPU is handling 50-75% of the LLM layers, you should get a decent tok/sec speed (unless you're running really really large models).

Re: MemoryCache: Augmenting local AI with browser data

#99

Post by ElectricalUnion »

orbital-decay wrote: post #36

Classic bookmarks have failed because mnemonic organization doesn't scale. This kind of interface does, and can replace it entirely if done right. Thinking of it, something like this can be used for all your local files as well, acting as a better version of the old filesystem-as-a-database idea. Or for a specific knowledge base (think LLM-powered Zotero).

Wasn't this the idea behind "Networked Environment for Personal, Ontology-based Management of Unified Knowledge" (Nepomuk) Semantic Desktop?

Assuming that you can coerce the LLM to fill in the RDF correctly, and that we now have much more memory and faster storage, it might work.

Re: MemoryCache: Augmenting local AI with browser data

#100

Post by ayewo »

jval43 wrote: post #52
danielovichdk wrote: post #39

My usage with browsing is not relevant for this. I don't want to "chat" with my browsin g history. I would simply love my browser would index my bookmarks on my OS so I could search the actual content of those bookmarks. The feedback loop coming gained from chatgtp will I assume always be way better than my local gpt equivalent. But often I bookmark pages where I know the information on there are important enough for…

Didn't Chrome do this at the very beginning, when it was initially released? I faintly remember that being a feature. Personally I would already be content if my browsers didn't forget their history all the time, both Firefox and Safari history is way too short-lived.

You were probably thinking of Google Desktop which could search almost anything on your machine.

https://en.wikipedia.org/wiki/Google_Desktop

Post reply on HN