Live data from Hacker News

Show HN: Apfel – The free AI already on your Mac

apfel.franzai.com

61–70 of 180 posts

Re: Show HN: Apfel – The free AI already on your Mac

#66
Would really love to see a web api standard for on device llms. This could get us closer. Some in-browser language model usage could be very powerful. In the interim maybe a little protocol spec + a discovery protocol used with browser plugins, web apps could detect and interface with on-device llms making it universally available.

Re: Show HN: Apfel – The free AI already on your Mac

#67

I like the approach of running everything locally. I'm strongly of the opinion that the privacy angle for local models is going to keep getting stronger and more relevant. The amount of articles that come out about accidents happening because of people handing too much context to cloud models the more self reinforcing this will become.

local is best for privacy, but i personally think you don't need to go local. anthropic, google, openai etc, decided that their consumer ai plans would not be private. partly to collect training data, the other half to employ moderators to review user activity for safety. we trust that human moderators will not review and flag our icloud docs, onedrive or gmail, or aggregate such documents into training data for llms…

> i personally think you don't need to go local.

I personally think everyone should default to using local resources. Cloud resources should only be used for expansion and be relatively bursty rather than the default.

Re: Show HN: Apfel – The free AI already on your Mac

#69

Earlier quoted context omitted.

That's the way things have to go. Business risk is too high having everything ran over exposed networks.

what i say about this, is that an llm is just a big file, there is nothing 'not private' about it. if you are happy with off-prem then the llm is ok too, if you need on-prem this is when you will need local.

> an llm is just a big file, there is nothing 'not private' about it.

The private thing is the prompt.

But also, a local LLM opens up the possibility of agentic workflows that don't have to touch the Internet.

Re: Show HN: Apfel – The free AI already on your Mac

#70

Would really love to see a web api standard for on device llms. This could get us closer. Some in-browser language model usage could be very powerful. In the interim maybe a little protocol spec + a discovery protocol used with browser plugins, web apps could detect and interface with on-device llms making it universally available.

https://webmachinelearning.github.io/prompt-api/

Already in Chrome as an origin trial: https://developer.chrome.com/docs/ai/prompt-api

Post reply on HN