Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Brave Leo now uses Mixtral 8x7B as default

brave.com

Post reply on HN
Print view View original

41–50 of 184 posts

Re: Brave Leo now uses Mixtral 8x7B as default

#41

Post by srid »

davikr wrote: post #4

It's nice using Brave because you have Chromium's better performance, without having to worry about Manifest V2 dying and taking adblocking down with it. I have uBlock Origin enabled, but it has barely caught anything that slipped past the browser filters.

> I have uBlock Origin enabled, but it has barely caught anything that slipped past the browser filters.

I have been completely satisfied with Brave's builtin ad-blocker. Does uBlock Origin catch anything in particular that the builtin one does not?

Re: Brave Leo now uses Mixtral 8x7B as default

#42

Post by guipsp »

steve_rambo wrote: post #19
croes wrote: post #16

Earlier quoted context omitted.

Brave"s support of Manifest V3 is totally dependent on Google and Chrome >Brave will support uBO and uMatrix so long as Google doesn’t remove underlying V2 code paths (which seem to be needed for Chrome for enterprise support, so should stay in the Chromium open source) https://twitter.com/BrendanEich/status/1534893414579249152

It doesn't really matter much in practice. The built-in adblocker (which does not rely on extension APIs) has excellent performance, about as effective as ublock origin, and supports the same filter lists.

The built-in adblocker still relies on a large amount of extension APIs.

Re: Brave Leo now uses Mixtral 8x7B as default

#43

Post by rozab »

srid wrote: post #41
davikr wrote: post #4

It's nice using Brave because you have Chromium's better performance, without having to worry about Manifest V2 dying and taking adblocking down with it. I have uBlock Origin enabled, but it has barely caught anything that slipped past the browser filters.

> I have uBlock Origin enabled, but it has barely caught anything that slipped past the browser filters. I have been completely satisfied with Brave's builtin ad-blocker. Does uBlock Origin catch anything in particular that the builtin one does not?

I couldn't see Brave being able to counter, say, the recent YouTube anti-adblock push as quickly as the open source community did. I could see that kind of stunt becoming more common as Google tries to nail the coffin shut and deny their competitors this USP

Re: Brave Leo now uses Mixtral 8x7B as default

#46

Post by DougBTX »

beck5 wrote: post #27
rhdunn wrote: post #2

If you want to run Mixtral 8x7B locally you can use llama.cpp (including with any of the supporting libraries/interfaces such as text-generation-webui) with https://huggingface.co/TheBloke/Nous-Hermes-2-Mixtral-8x7B-S... . The smallest quantized version (2bit) needs 20GB of RAM (which can be offloaded onto the VRAM of a decent 4090 GPU). The 4bit quantized versions are the largest models that can just about fit onto…

Dumb question, but how can a 32 bit number be converted to 2 bits and still be useful? It seems like magic.

Nice graphs here: https://github.com/ggerganov/llama.cpp/pull/1684

So for example, 2 bit version of the 30B is much worse than the original, but still better than the 13B model.

Also, there are lots of extra details, eg, not all of the weights are 2 bit, and even the 2 bit weights are higher than that overall as groups of quantised weights share scale factors stored elsewhere.

Re: Brave Leo now uses Mixtral 8x7B as default

#47

Post by SparkyMcUnicorn »

srid wrote: post #41
davikr wrote: post #4

It's nice using Brave because you have Chromium's better performance, without having to worry about Manifest V2 dying and taking adblocking down with it. I have uBlock Origin enabled, but it has barely caught anything that slipped past the browser filters.

> I have uBlock Origin enabled, but it has barely caught anything that slipped past the browser filters. I have been completely satisfied with Brave's builtin ad-blocker. Does uBlock Origin catch anything in particular that the builtin one does not?

Brave's ad blocking is compatible (and uses) the uBlock Origin lists, so you shouldn't really notice a difference between having uBO enabled or disabled in brave.

Re: Brave Leo now uses Mixtral 8x7B as default

#49

Post by [deleted] »

srid wrote: post #41
davikr wrote: post #4

It's nice using Brave because you have Chromium's better performance, without having to worry about Manifest V2 dying and taking adblocking down with it. I have uBlock Origin enabled, but it has barely caught anything that slipped past the browser filters.

> I have uBlock Origin enabled, but it has barely caught anything that slipped past the browser filters. I have been completely satisfied with Brave's builtin ad-blocker. Does uBlock Origin catch anything in particular that the builtin one does not?

[deleted]

Re: Brave Leo now uses Mixtral 8x7B as default

#50

Post by DougBTX »

beefield wrote: post #38
beck5 wrote: post #27

Earlier quoted context omitted.

Dumb question, but how can a 32 bit number be converted to 2 bits and still be useful? It seems like magic.

I think of it with this kind of analogy: the original image is stored with 32 bit color scheme. You can reduce the color scheme to 16 bit accuracy and still figure out pretty well what the image is about. 2 bit is stretching this to a bit far, basically either pixel is white or it is black, but even if you lose lots of nuances in the image, in many images even that gives you some idea whats going on in the image.

That’s an interesting question, I wonder if there is an analogy in quantisation to image dithering?
Post reply on HN