The question I have is, why should your browser also be the interface to local AI models? Seems totally unrelated to be honest.
It makes it possible to do, in half an hour, tasks which were completely unnecessary to do before.
[deleted]
Opera becomes the first major browser with built-in access to local AI models
81–90 of 139 posts
Re: Opera becomes the first major browser with built-in access to local AI models
#82I actually just submitted something quite relevant - a side project we soft-launched today that uses LLMs to analyse and group browser tabs across various browsers and devices. It turns out that it’s super demanding for today’s models, but with some optimisations and experimentation, we made it work pretty well. Running local LLMs might be a heavy order currently to get the job done, but in the near future I don't se…
This is useful. Why the step of involving LLMs though? I note you cluster the tabs and then GPT-4 is involved to name them. But my tab groups don't usually need names - just the icons tells me what I mostly need to know. Could this work locally better using much smaller sentence-transformer models?
That's a good question. If you have many tabs open from the same few websites (depending on what those websites are), maybe just grouping them based on domain names would be enough to provide context.
But LLMs are needed if you want the product to have a deeper understanding of everything that you are reading and really organise it into groups. You might be reading about architecture across three devices, multiple browsers, from a bunch of different websites. This gives you the opportunity to reunite them and really dive into that topic when you need to.
LLMs are also used to create summaries of each page. So, if some content takes 30 minutes to read, you can have them extract all the interesting information for you in bullet points and based on that you can decide if its worth spending the 30 minutes or if you would rather just close that tab.
So, in short, it's about capabilities. You can have just simple statistical models and regex rules filtering similar websites into predefined categories, or you can have a tool that truly organises your reading and shortens it for you. But for the latter, you need complex models handling a lot of context.
Re: Opera becomes the first major browser with built-in access to local AI models
#83Earlier quoted context omitted.
If my data is already in the browser (Sheets, Gmail, other websites to scrape) why have another app instead of doing the work in the browser?
While we're at it, why not shove our financial passwords etc. into our HTTP headers for every website we visit? That would be awfully convenient. You'd never lose them or need to deal with another native application. Just open any web page that echoes all HTTP headers and then check your account balance. Or maybe having a separation of concerns for different applications in a general purpose computer is worth the fri…
I don't get it.
Re: Opera becomes the first major browser with built-in access to local AI models
#84Earlier quoted context omitted.
From my understanding it comes from a law passed that allows unlimited access by state intelligence services in China to any firms customer data. "The most controversial sections of the law include Article 7 which potentially compels businesses registered or operating in the People's Republic of China to hand over information to Chinese intelligence agencies such as the MSS and to conceal the fact that they do so." […
The same laws apply to American companies for American data requested by American agencies, is that better? And likely Norwegian too, but I don't know the specifics there.
>for American data
Re: Opera becomes the first major browser with built-in access to local AI models
#85The question I have is, why should your browser also be the interface to local AI models? Seems totally unrelated to be honest.
Exactly. You can claim to be the "first" at something very easily this way. Check out my browser, we're the first with an integrated flight simulator!
Re: Opera becomes the first major browser with built-in access to local AI models
#86Browsers are for browsing internet. So many of them are now turning into bloatware..
You are confusing the Internet with the web. You do not "browse" the Internet. Browser suites are for using the Internet, and the Netscape Suite provided numerous tools to use various protocols on the Internet. One of those happened to be a browser for browsing the web. I say this to make it clear that the "now" in your comment ignores past and present browsers across all platforms.
You know damn well that people often use "internet" and "web" interchangeably.
Re: Opera becomes the first major browser with built-in access to local AI models
#87What are any possible reasons to have some generative network pre-trained by someone else as a part of some proprietary software?
[deleted]
Re: Opera becomes the first major browser with built-in access to local AI models
#88I want my user agent to have nothing to do with LLMs.
Last time I checked, the browser's purpose was to serve web applications.
Re: Opera becomes the first major browser with built-in access to local AI models
#89Does that mean Opera doesn't consider Brave a "major browser" or that Brave's Leo is not a local model?
Brave's Leo appears to be on their servers, not run locally.
They advertise it to the user as though it's local. They just say "built right into the browser". Certainly misleading.
Re: Opera becomes the first major browser with built-in access to local AI models
#90The question I have is, why should your browser also be the interface to local AI models? Seems totally unrelated to be honest.
Opera has been bundling in a mail client, rss reader, calendar app etc for ages now. I also always thought it was weird but Opera people seem to like it, to the point that inspired browsers like Vivaldi also do that.
>Opera has been bundling in a mail client, rss reader, calendar app etc for ages now.
Opera has been bundling stuff like that, even a BitTorrent client, even when they were still a Norwegian owned company.