Orbit by Mozilla

#1

Post by blinky88 » Tue, Dec 31, 2024, 1:20 AM UTC

Orbit by Mozilla
orbitbymozilla.com

Re: Orbit by Mozilla

#2

Post by beretguy » Tue, Dec 31, 2024, 1:50 AM UTC

I'd rather have tab groups.

Re: Orbit by Mozilla

#3

Post by jsheard » Tue, Dec 31, 2024, 1:53 AM UTC

For those wondering, this uses cloud-hosted AI models. But it's completely free to use so Mozilla is just paying the cloud bills out of pocket. Maybe not the best idea given their increasingly precarious financial situation?

Re: Orbit by Mozilla

#4

Post by lordofgibbons » Tue, Dec 31, 2024, 1:55 AM UTC

Sounds extremely expensive. How is this paid for?

Also, does anyone know if we'd be able to point it to our own LLM instance for the guarantee of our data being secure?

Re: Orbit by Mozilla

#5

Post by mhitza » Tue, Dec 31, 2024, 1:56 AM UTC

> How does Orbit work?

> Orbit is a Firefox add on that uses AI to summarize and answer queries about web content such as articles and videos.

> When a user asks Orbit to summarize or query content, Orbit gathers the context (eg. text, images, videos, etc.) of the page the user is viewing and provides a summary or answer. Orbit works on websites including Gmail, Wikipedia, NY Times, YouTube, and more.

> For the current version, we are using a Mistral LLM (Mistral 7B) hosted within Mozilla’s GCP instance.

It's interesting they're going with Mistral 7B. Is anybody else using Mistral 7B in production? And in what role?

I've considered using it for general knowledge type questions, and as a way to classify information, but would have never considered it for summarization type tasks due to it's limited context size (8k).

Re: Orbit by Mozilla

#6

Post by pilotneko » Tue, Dec 31, 2024, 1:58 AM UTC

mhitza wrote: post #5

> How does Orbit work? > Orbit is a Firefox add on that uses AI to summarize and answer queries about web content such as articles and videos. > When a user asks Orbit to summarize or query content, Orbit gathers the context (eg. text, images, videos, etc.) of the page the user is viewing and provides a summary or answer. Orbit works on websites including Gmail, Wikipedia, NY Times, YouTube, and more. > For the curre…

Mistral 7B has a context window of 32k. I use it in production for medical summarization tasks supporting appeals and physician advisory services.

Re: Orbit by Mozilla

#7

Post by neilv » Tue, Dec 31, 2024, 2:01 AM UTC

Huge heading:

> Commitment to privacy

Buried as the last sentence in a collapsed box at the bottom of the page:

> For the current version, we are using a Mistral LLM (Mistral 7B) hosted within Mozilla’s GCP instance.

And why is it "...Mozilla's GCP instance", not "We quietly send all your data to Google servers, and everyone pinkie-swears that's totally privacy-respecting"?

Re: Orbit by Mozilla

#8

Post by janice1999 » Tue, Dec 31, 2024, 2:01 AM UTC

jsheard wrote: post #3

For those wondering, this uses cloud-hosted AI models. But it's completely free to use so Mozilla is just paying the cloud bills out of pocket. Maybe not the best idea given their increasingly precarious financial situation?

I never understood why Mozilla doesn't offer paid privacy respecting services (outside basic sync that already exists) like email, cross platform password storage etc.

Re: Orbit by Mozilla

#9

Post by easygenes » Tue, Dec 31, 2024, 2:02 AM UTC

beretguy wrote: post #2

I'd rather have tab groups.

Sidebery is my go to for that.

https://github.com/mbnuqw/sidebery

Re: Orbit by Mozilla

#10

Post by koolala » Tue, Dec 31, 2024, 2:02 AM UTC

jsheard wrote: post #3

For those wondering, this uses cloud-hosted AI models. But it's completely free to use so Mozilla is just paying the cloud bills out of pocket. Maybe not the best idea given their increasingly precarious financial situation?

Don't worry, the money will gravitate back towards Mozilla because AI = Search.