Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Orbit by Mozilla

orbitbymozilla.com

Post reply on HN
Print view View original

381–390 of 417 posts

Re: Orbit by Mozilla

#381

Post by furyofantares »

rtpg wrote: post #193
mentalgear wrote: post #181

I'm reading a lot of criticism here, some I understand, but honestly, this sounds pretty good for a free LLM service: "Orbit doesn't require account creation or save your session data." Maybe we shouldn't be too critical of Mozilla for providing a privacy-first LLM service - for free. The other big privacy-first LLM provider is Apple, which requires users to have their devices/subscriptions to use, and definitely use…

> Maybe we shouldn't be too critical of Mozilla for providing a privacy-first LLM service - for free. The other big privacy-first LLM provider is Apple, which requires users to have their devices/subscriptions to use, and definitely uses advanced telemetry by default. There is a very fundamental critique here: a service being offered for free like this is being subsidized, messing with the general market dynamics tha…

> messing with the general market dynamics that really should be making all of these tools cost way more money to begin with.

Prices have been dropping very rapidly due to technological progress. I feel like a lot of threads recently have had people confused about costs because they either are stuck on prices they learned about 6-12 months ago, or because they're failing to project further rapid reductions of price (I can't predict the future myself, but I'm not gonna bet on inference prices stabilizing all of a sudden.)

I mean, it definitely costs more than FREE. But I think it's closer to free than many commenters realize, and continuing to go that direction faster than many commenters realize.

Re: Orbit by Mozilla

#382

Post by dbmnt »

aabiji wrote: post #320
RadiozRadioz wrote: post #31

I installed it and it's a giant floating popup that's permanently on your screen. You can enable the "minimal" theme in the settings to turn it into a smaller-but-still-big pill shape. It doesn't look like there's a way to hide it in a context menu, at least not one I can see. I don't fancy having a random floaty object in the way of my webpages, no thank you. Edit: It appears to go away occasionally. This UX is uncl…

If you pin the extension in the toolbar, there's an option to "disable" the extension. The floating popup goes away and using the extension to summarize still works.

Wow, that's really not intuitive, but it works. Thanks!

Re: Orbit by Mozilla

#383

Post by dbmnt »

tangoalpha wrote: post #59

Looks like there is no way i can use it without giving up on screen real estate. I'd love to have it pinned in the browser toolbar and I click it when I need it. But it wouldn't allow itself to be hidden and needs to have a floating circle taking up page real-estate. Disabled it.

Someone provided the solution in another comment.

After pinning the extension, click on it and deselect the "enabled" option (the line with the purple X). This will kill the floating orb UI but you can still click on the extension in the toolbar to use it.

Re: Orbit by Mozilla

#384

Post by dbmnt »

dingnuts wrote: post #358
knallfrosch wrote: post #343

Earlier quoted context omitted.

In 2-3 years, devices will run this locally.

Oh, they will? Someone else on this site told me they would be running locally in 2-3 years, back in 2022. Someone on this site also assured me ten years ago that we'd have full self driving by 2020.

I mean, the iPhone 16 is already running LLMs locally. So yeah.

Re: Orbit by Mozilla

#386

Post by getwiththeprog »

dingnuts wrote: post #358
knallfrosch wrote: post #343

Earlier quoted context omitted.

In 2-3 years, devices will run this locally.

Oh, they will? Someone else on this site told me they would be running locally in 2-3 years, back in 2022. Someone on this site also assured me ten years ago that we'd have full self driving by 2020.

Firefox released a very easy to deploy local LLM around a year ago. https://github.com/Mozilla-Ocho/llamafile https://ai-guide.future.mozilla.org/content/running-llms-loc...

It works.

Re: Orbit by Mozilla

#387

Post by altairprime »

Groxx wrote: post #378
altairprime wrote: post #360

Earlier quoted context omitted.

What % of the money that is injected into Mozilla annually is paid by Google?

Does it matter? Without it, there would be no money from Google. You're moving the goalpost rather substantially. "It makes no money" and "it costs millions to maintain" -> it pulls in hundreds of millions per year, the majority of their income. They can afford to focus on it.

Fair enough!

Re: Orbit by Mozilla

#388

Post by progval »

smarnach wrote: post #375
mort96 wrote: post #323

Earlier quoted context omitted.

They literally have Google Analytics which sends telemetry data to Google integrated into the Firefox UI.

Can you substantiate this a bit more? Do you have a link?

https://github.com/mozilla/addons/issues/3145

Worth noting that the comment closing the issue mentions:

> You can disable Google Analytics in about:addons by setting your Do Not Track status to on.

> Again: this only affects users who visit the page with Tracking Protection on (which automatically enables DNT) or who manually set their DNT status to on.

but Firefox removed the DNT control last month (https://bugzilla.mozilla.org/show_bug.cgi?id=1928087), though it kept the Tracking Protection control and privacy.donottrackheader.enabled is still available in about:config.

Re: Orbit by Mozilla

#389

Post by andro_dev »

Mozilla first needs to regain the trust of its users. They aren't privacy-first at all, they run a lot of telemetry on their users. Have you ever checked the number of DNS queries and IP requests that go to Firefox servers every minute? If you haven't, I have, and it is a lot. They literally ping home every minute in the name of network connectivity and other things, if you believe it. I don't mind using Mozilla products, but I just don't trust their motives and data practices.

If you want privacy first AI in the browser here are the tools

https://ollama.com

https://github.com/n4ze3m/page-assist

Re: Orbit by Mozilla

#390

Post by lhl »

ph1lw wrote: post #277

Unfortunately no BYOLLM. Brave supports bringing your own LLM e.g. through Ollama Besides that I'm using AI Summary Helper plugin for Chromium-based browsers https://philffm.github.io/ai-summary-helper/ which also allows using Ollama (or OpenAI / Mistral), asking questions to articles and inserting summaries right into the DOM (which is perfect for hoarding articles / forwarding them to Kindle)

Sort of funny for the lack of local options considering that Mozilla funds llamafile even. Hopefully they allow some API integration, if they are using standard OpenAI API calls, it should be easy to enable swapping the endpoint.

Also, while it's nice to have a service option for those without any spare compute, I think it's a bit of a shame on the model considering how even at the 7B class, models like Llama 3.1 8B, Qwen 2.5 8B or Tulu 3 8B, Falcon 3 7B, all clearly outclass Mistral 7B (Mistral 7B is also very bad at multilingual, and is particularly inefficient at multilingual tokenization).

The current best fully open weights (Apache 2.0 or similar) small models currently are probably: OLMo 2 7B, Qwen 2.5 7B, Granite 3.1 8B, and Mistral Nemo Instruct (12B)

There's been a recent launch of a "GPU-Poor" Chat Arena for those interested in scoping out some of the smaller models (not a lot of ratings so very noisy, take it with a grain of salt): https://huggingface.co/spaces/k-mktr/gpu-poor-llm-arena

Post reply on HN