Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Mistral X Mozilla: Private, Multilingual AI Browsing

mistral.ai

Post reply on HN
Print view View original

191–200 of 213 posts

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#191

Post by tomhow »

nosioptar wrote: post #132
pessimizer wrote: post #116

Earlier quoted context omitted.

You're talking out of your ass. It is so ironic that "normal people don't care about privacy, just you nerds" is an HN meme. Everybody I know cares, often in an extreme way, and I barely hang out with technical people in real life. I've met people so irrational and nontechnical about modern invasions of privacy that they think that it is being driven by demons. The reason this is a meme on HN is because tons of HN po…

I think youre right. The least techy people I know where the first to ditch Mozilla when they started to see ads in Firefox.

Can you please not go on enraged tirades like this on HN? You've posted several fulminatory comments in this thread alone and at least one more in another thread today. This is not what HN is for and it destroys what it is for. You may not owe Mozilla better, but you owe HN better if you want to participate here. This is only a place where people want to participate becuase enough people make the effort to raise the standards rather than drag them down. https://news.ycombinator.com/newsguidelines.html

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#192

Post by bluebarbet »

smsm42 wrote: post #137
walrus01 wrote: post #47

Earlier quoted context omitted.

I am not trying to defend Mozilla doing this, and I don't support sending data to cloud based services like this in a way that users won't understand. But I also think that the state of the art in small LLM and user device capabilities aren't there yet to put a "good enough to be actually useful" local-only LLM as a prepackaged thing in a mass market distributed browser. You don't want a browser that takes 10GB of ex…

> that it's not some big American cloud company but a relatively small startup in France How it's any better? Small companies can be bought by big companies. French government is as capable of trampling over their citizen's privacy the moment they feel they need it as US government is. And putting a squeeze on a small startup is way easier than on a major cloud company (not that either is particularly hard). Also, Op…

>How it's any better? Small companies can be bought by big companies. French government is as capable of trampling over their citizen's privacy the moment they feel they need it as US government is.

It's better for Europeans because the company in question is European and so will not export their data to New Jersey. And because any success it has will presumably better benefit France and Europe.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#193

Post by bluebarbet »

AstralSerenity wrote: post #90
djray wrote: post #89

They misspelled their own company name: "...working together to bring Mistal’s scientific innovations to consumers around the world" A quick proof-read wouldn't have gone amiss here. I also fail to see how privacy is enhanced by sending private browsing data to a cloud service which then forwards it to an LLM, in addition to storing 'memories' and dredging through my browser history.

On the bright side, at least we know it was typed by human hands!

Perhaps it was planted (satire)

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#194

Post by SahAssar »

wky wrote: post #74
mossTechnician wrote: post #60

Earlier quoted context omitted.

This sentence is eye-opening: > Smart Window infers information about you based on your interactions with the assistant and your Firefox browsing activity, including websites you have visited. This may include activity outside of Smart Window (such as in classic windows)... Privacy-minded users who want to try this feature would need to create a totally separate browser profile to avoid data leaks.

You can control this in the settings: - Learn from chats in Smart Window - Learn from browsing in Classic and Smart Windows

The real question here is what is the default? Is it opt-in or opt-out?

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#195

Post by vvpan »

mixcocam wrote: post #26

Would be very cool if you could type a long query and the model would just build an advanced google search query using what you typed. You could even ship a tiny model in the browser itself that does that. Something like: "blog posts which talk about using sending emails to yourself as a notes taking mechanism". The output could look like: "note taking" OR "notes" ("emailing yourself" OR "email to myself" OR "email y…

I feel like much of what Perplexity does can be accomplished that way.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#196

Post by rsolva »

rsolva wrote: post #181
syntaxing wrote: post #87

It’s not obvious but you can use this with your own local (or any) models. https://support.mozilla.org/en-US/kb/smart-window-byom

I tried adding my own endpoint, but the save button was still greyed out so it did not work. Maybe the feature is not fully implemented yet? In about:config, I could add the endpoint and api key, but not the model name.

Keys that needs to be set in about:config

- browser.smartwindow.apiKey

- browser.smartwindow.customEndpoint

- browser.smartwindow.model

Adding my http endpoint (using LAN IP) seems to work, getting around the check in the regular settings.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#197

Post by ANighRaisin »

pessimizer wrote: post #120
mixcocam wrote: post #26

Would be very cool if you could type a long query and the model would just build an advanced google search query using what you typed. You could even ship a tiny model in the browser itself that does that. Something like: "blog posts which talk about using sending emails to yourself as a notes taking mechanism". The output could look like: "note taking" OR "notes" ("emailing yourself" OR "email to myself" OR "email y…

There's no such thing as an advanced google search query anymore. The second will give you worse results than the first (without quotes.)

Well, it would be helpful for scholarly articles.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#198

Post by odo1242 »

horsawlarway wrote: post #98
walrus01 wrote: post #47

Earlier quoted context omitted.

I am not trying to defend Mozilla doing this, and I don't support sending data to cloud based services like this in a way that users won't understand. But I also think that the state of the art in small LLM and user device capabilities aren't there yet to put a "good enough to be actually useful" local-only LLM as a prepackaged thing in a mass market distributed browser. You don't want a browser that takes 10GB of ex…

I'll ding Mozilla directly then - Since your "we can't do this yet" approach is actually the literal thing Chrome is shipping... https://developer.chrome.com/docs/ai/built-in/overview?_gl=1...

But the built in AI model in Chrome is 4GB of RAM, 4GB of disk space, and is still only used in a couple places

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#200

Post by nullc »

walrus01 wrote: post #189
nullc wrote: post #185

Earlier quoted context omitted.

No it doesn't. TODAY you can run with good performance a local LLM entirely on CPU that can do translation, summaries, search assistance, and all the things mentioned here. On a 8GB system with a SSD it might be a bit slow due to having to keep experts on disk, but perfectly usable. On fast systems it may well be faster than the network round trip for many tasks.

> No it doesn't. TODAY you can run with good performance a local LLM entirely on CPU that can do translation, summaries, search assistance, and all the things mentioned here. What specific LLM and how much RAM does it take up to load? How does it run on somebody's 8GB RAM $600 laptop they bought from Best Buy? What pp/s and token/s rate on that hardware?

https://news.ycombinator.com/item?id=49728887

How much ram has a fair amount of flexibility since MoE can be kept on flash and swapped in at a performance cost, and depending on how small a context you can use.

Post reply on HN