Bad marketing header "AI you can trust".
Orbit by Mozilla
11–20 of 417 posts
Re: Orbit by Mozilla
#12Info from the FAQ:
- Currently using Mistral 7B, but ability (by Mozilla) to swap the model used to another open source at any point.
- Hosted "by Mozilla" on their GCP instance.
- No obvious info about what it will cost them to run this since it is free to use.
- No training on user data.
Like others here, I'm very curious about the cost for Mozilla to run this service. It may be less than it initially appears given the 7B model they chose. I do wish they would focus their efforts on creating a very long-term endowment to pay devs for continued Firefox development in lieu of projects like this given the tenuous situation with their Google funding.
I'm not against this kind of thing in theory, but I hope it's being done in a cost-sustainable way.
Re: Orbit by Mozilla
#13Re: Orbit by Mozilla
#14Huge heading: > Commitment to privacy Buried as the last sentence in a collapsed box at the bottom of the page: > For the current version, we are using a Mistral LLM (Mistral 7B) hosted within Mozilla’s GCP instance. And why is it "...Mozilla's GCP instance", not "We quietly send all your data to Google servers, and everyone pinkie-swears that's totally privacy-respecting"?
Any revelation that Google is siphoning data out of other companies GCP instances would be so earth-shattering I don't think it is happening.
Re: Orbit by Mozilla
#15Is Mistral AI open source?
Re: Orbit by Mozilla
#16> How does Orbit work? > Orbit is a Firefox add on that uses AI to summarize and answer queries about web content such as articles and videos. > When a user asks Orbit to summarize or query content, Orbit gathers the context (eg. text, images, videos, etc.) of the page the user is viewing and provides a summary or answer. Orbit works on websites including Gmail, Wikipedia, NY Times, YouTube, and more. > For the curre…
Mistral 7B has a context window of 32k. I use it in production for medical summarization tasks supporting appeals and physician advisory services.
Why are you confident to use such a tiny model on something so critical?
I would never use anything smaller than a 70B model for anything even vaguely medical related!
Re: Orbit by Mozilla
#17I'd rather have tab groups.
Looks like it's just around the corner. See previous post: https://news.ycombinator.com/item?id=42499693
Re: Orbit by Mozilla
#18[flagged]
Re: Orbit by Mozilla
#19For those wondering, this uses cloud-hosted AI models. But it's completely free to use so Mozilla is just paying the cloud bills out of pocket. Maybe not the best idea given their increasingly precarious financial situation?
I never understood why Mozilla doesn't offer paid privacy respecting services (outside basic sync that already exists) like email, cross platform password storage etc.
Because everyone who cares about it is already using some sort of a service like that, and it’s incredibly niche market so it’s not worth the effort to develop and support such projects.
Re: Orbit by Mozilla
#20I'd rather have tab groups.
Tab groups are on by default in nightly, and though I haven’t been on the computer much this past week they seem well realised. This article suggests they can be enabled in other versions, but I only really use nightly so I haven’t tried it..
https://www.ghacks.net/2024/12/03/how-to-enable-tab-groups-i...