Live data from Hacker News

Mistral X Mozilla: Private, Multilingual AI Browsing

mistral.ai

201–210 of 211 posts

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#201

Earlier quoted context omitted.

neglecting existing customers in an attempt to gain larger market share is certainly a play

Ah yes, the customers of Mozilla, who are certainly paying users and not just people whining and saying BACK IN MY DAYS IN THE LAST MILLENIUM IT WAS DIFFERENT. Get over it gramps, things are changing. Mozilla spent ten years trying to mostly appeal to these people by staying very conservative, and it got them nothing but abuse and harassment from people not realising that staying stuck in the past is a death sentence…

like I said, neglecting existing customers in an attempt to gain larger market share is certainly a play

the rest of your post seems to hinge on some judgement you think I made about that

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#203

Would be very cool if you could type a long query and the model would just build an advanced google search query using what you typed. You could even ship a tiny model in the browser itself that does that. Something like: "blog posts which talk about using sending emails to yourself as a notes taking mechanism". The output could look like: "note taking" OR "notes" ("emailing yourself" OR "email to myself" OR "email y…

There's no such thing as an advanced google search query anymore. The second will give you worse results than the first (without quotes.)

There is. By default it tries to obey your query. But if that query returns no results, only then it makes a best-effort attempt to return something vaguely related.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#205
post #22

Earlier quoted context omitted.

I don't think it is comparable. Nowhere in the news they say it is offline but IMO Gemini Nano is offline (?) I'm not a Google fan but I never understood the outrage as it is a local model ... sure, you have to trust them, but if you use their browser you already do.

> Nowhere in the news they say it is offline Reading HN, I 100% understood “private” to be marketing copy for “local inference”. How else could the information be kept private? I begrudgingly suppose that there is precedent for the usage, like Apple’s Private Relay, but I really don’t think they are comparable.

New apple watch markets their new listening feature as private, but they are not happening on device.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#206
post #137

Earlier quoted context omitted.

I am not trying to defend Mozilla doing this, and I don't support sending data to cloud based services like this in a way that users won't understand. But I also think that the state of the art in small LLM and user device capabilities aren't there yet to put a "good enough to be actually useful" local-only LLM as a prepackaged thing in a mass market distributed browser. You don't want a browser that takes 10GB of ex…

> that it's not some big American cloud company but a relatively small startup in France How it's any better? Small companies can be bought by big companies. French government is as capable of trampling over their citizen's privacy the moment they feel they need it as US government is. And putting a squeeze on a small startup is way easier than on a major cloud company (not that either is particularly hard). Also, Op…

Let's not pretend that EU data laws are not far more stringent and actually enforced than whatever the US has. Like sure, the government with a jury decision may acquire some person's data. But it's not getting sold to whichever-random-company-offered-the-highest.

Also, some shady TOS is also not enough to override the law in the EU, you have much more protection as a user here.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#207

Earlier quoted context omitted.

I am not trying to defend Mozilla doing this, and I don't support sending data to cloud based services like this in a way that users won't understand. But I also think that the state of the art in small LLM and user device capabilities aren't there yet to put a "good enough to be actually useful" local-only LLM as a prepackaged thing in a mass market distributed browser. You don't want a browser that takes 10GB of ex…

Well, it depends on the task, doesn't it? "running shoes I looked at last week" / "Here's what I found in your browsing history:" doesn't need a 119 billion parameter frontier model; it's a RAG problem for the 0.6 B embedding models. That's an example Mozilla offers. Presumably to explain to their users why it's essential they hand over their last week's browsing history for this convenience (but it isn't! Hardly for…

Firefox is already using small local models for a few things, like tab grouping and link previews. I assume that this is for cases where a reasonably sized model isn't adequate.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#208
post #191

Earlier quoted context omitted.

I think youre right. The least techy people I know where the first to ditch Mozilla when they started to see ads in Firefox.

Can you please not go on enraged tirades like this on HN? You've posted several fulminatory comments in this thread alone and at least one more in another thread today. This is not what HN is for and it destroys what it is for. You may not owe Mozilla better, but you owe HN better if you want to participate here. This is only a place where people want to participate becuase enough people make the effort to raise the…

I love this site

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#209
post #148

Earlier quoted context omitted.

Well, it depends on the task, doesn't it? "running shoes I looked at last week" / "Here's what I found in your browsing history:" doesn't need a 119 billion parameter frontier model; it's a RAG problem for the 0.6 B embedding models. That's an example Mozilla offers. Presumably to explain to their users why it's essential they hand over their last week's browsing history for this convenience (but it isn't! Hardly for…

Let's say the goal is doing something for work, so accuracy is important, and you prefer for it to be a nice reading experience, like a good translation. As long as cloud model are somewhat better in these things, it's good that users would have the option to use cloud models.

Dont use this for work unless it has been verified by your corporate security and legal teams. Sharing business data with a company with which you dont have a enterprise agreement can land you in serious trouble.

Re: Mistral X Mozilla: Private, Multilingual AI Browsing

#210
post #200

Earlier quoted context omitted.

> No it doesn't. TODAY you can run with good performance a local LLM entirely on CPU that can do translation, summaries, search assistance, and all the things mentioned here. What specific LLM and how much RAM does it take up to load? How does it run on somebody's 8GB RAM $600 laptop they bought from Best Buy? What pp/s and token/s rate on that hardware?

https://news.ycombinator.com/item?id=49728887 How much ram has a fair amount of flexibility since MoE can be kept on flash and swapped in at a performance cost, and depending on how small a context you can use.

Well the linked thread mention 14700KF which is a 400$ processor and RTX 2070.

Beside its mentioned 5 or 6 gb of ram.

People run Firefox on pentium with less than 8gb of ram, just 4 or 5 years ago 4gb computer were still extremely common. Even Microsoft sold its surface devices with 4gb of ram, I was dumb enough to buy one.

To give a counterpoint, you could disable it on those low end devices.

But then people would complain about the size, like what happened with Google Chrome embedded llm.

I think there wasn’t any bad choice, mistral was the safest.

Post reply on HN