Given the broader Mozilla foundation's political biases, will these assistants be censored or heavily curated? I am reminded of when Mozilla chose to ban Dissenter, a free speech plugin powered by Gab, from its store. I've never used it but I found it distasteful that a company working on a basic utility program decided to become political. I don't understand why they cannot just focus on the basics and get those right. Still waiting for proper vertical tabs.
Orbit by Mozilla
51–60 of 417 posts
Re: Orbit by Mozilla
#52God damnit, all I want is one nook of the Internet where AI isn't being foisted on me.
Re: Orbit by Mozilla
#53Related. This is the bookmark I use to summarize websites using ChatGPT:
javascript:window.open('https://chatgpt.com/?q=summarize this page in 100 words: '+encodeURIComponent(window.location.href),'_blank');
Tested on Firefox and Chrome.
Some websites block ChatGPT and can't be summarized this way.
Works in incognito/anonymous mode and doesn't require a ChatGPT account.
You can probably use another AI service with this idea.
Re: Orbit by Mozilla
#54I wish they would copy this one https://github.com/webmachinelearning/prompt-api and include a few options for small self-hosted LLMs using WebGPU or some built-in accelerated AI for Firefox.
Re: Orbit by Mozilla
#55[dead]
Re: Orbit by Mozilla
#56Earlier quoted context omitted.
Mistral 7B has a context window of 32k. I use it in production for medical summarization tasks supporting appeals and physician advisory services.
Why are you confident to use such a tiny model on something so critical? I would never use anything smaller than a 70B model for anything even vaguely medical related!
> Why are you confident to use such a tiny model on something so critical?
Don't use any LLM for something critical. They can't be trusted innately due to their design, why on earth would you use them for something where you need reliability?
Re: Orbit by Mozilla
#57Why does Mozilla always spin their wheels releasing random side projects? Cloud-hosting an outdated tiny LLM that you can't swap out or run locally, to do basic summarization? This just doesn't feel like an area of strategic focus that makes sense for Mozilla. GPUs are expensive, talent to do inference well is expensive, and the actual product they're shipping seems pretty marginally useful at best. If they shipped v…
> Why does Mozilla always spin their wheels releasing random side projects? Because some project manager had "AI" on his performance goals this year. Firefox is buggy as hell - which is incomprehensible given its age, but older brother Netscape had the same problem 20-ish years ago. The Netscape 4.x days were absolute hell and you could go hardly a day without the browser crashing. Despite this, it's packed with nons…
> Because some project manager had "AI" on his performance goals this year.
Same reason Logitech did it, it's a totally arbitrary waste of resources
Re: Orbit by Mozilla
#58Why does Mozilla always spin their wheels releasing random side projects? Cloud-hosting an outdated tiny LLM that you can't swap out or run locally, to do basic summarization? This just doesn't feel like an area of strategic focus that makes sense for Mozilla. GPUs are expensive, talent to do inference well is expensive, and the actual product they're shipping seems pretty marginally useful at best. If they shipped v…
It's such a waste of resources. They should just focus in making a better browser.
Re: Orbit by Mozilla
#59Looks like there is no way i can use it without giving up on screen real estate. I'd love to have it pinned in the browser toolbar and I click it when I need it. But it wouldn't allow itself to be hidden and needs to have a floating circle taking up page real-estate.
Disabled it.
Re: Orbit by Mozilla
#60Earlier quoted context omitted.
I doubt this will ever happen. The minute Mozilla starts being relevant in search, Google will cut their billions USD/year sponsorship, killing Mozilla in the process. The incentives are not there.
> The minute Mozilla starts being relevant in search, Google will cut their billions USD/year sponsorship, killing Mozilla in the process. The incentives are not there. Google needs mozilla more than anyone. It would be a big win for the web if google stopped financing mozilla and had to deal with the consequences.
Why does Google need Mozilla at this point? Firefox has 2.6% market share. Sure, I imagine the cost/benefit ratio is slightly positive for Google, but Mozilla needs Google since that's the majority of their revenue; the reverse is definitely not true.