Live data from Hacker News

Show HN: Apfel – The free AI already on your Mac

apfel.franzai.com

41–50 of 180 posts

Re: Show HN: Apfel – The free AI already on your Mac

#42
Does the local LLM have access to personal information from the Apple account associated with the logged-in user? Maybe through a RAG pipeline or similar? Just curious if there are any risks associated with exposing this in a way that could be exploited via CORS or through another rogue app querying it locally.

Re: Show HN: Apfel – The free AI already on your Mac

#43
post #8

Any know if these only installed on Tahoe? I'm running Sequoia still and get an error about model not found.

> Apple Silicon Mac, macOS 26 Tahoe or newer, Apple Intelligence enabled

Yes, the model ships with Tahoe, not previous versions.

I too would love to try this for simple prompts but won’t be updating past Sequoia for the foreseeable future.

Re: Show HN: Apfel – The free AI already on your Mac

#44

I like the approach of running everything locally. I'm strongly of the opinion that the privacy angle for local models is going to keep getting stronger and more relevant. The amount of articles that come out about accidents happening because of people handing too much context to cloud models the more self reinforcing this will become.

local is best for privacy, but i personally think you don't need to go local.

anthropic, google, openai etc, decided that their consumer ai plans would not be private. partly to collect training data, the other half to employ moderators to review user activity for safety.

we trust that human moderators will not review and flag our icloud docs, onedrive or gmail, or aggregate such documents into training data for llms. it became the norm that an llm is somehow not private. it became a norm that you can't opt out of training, even on paid plans (see meta and google); or if you can opt out of training, you can't opt out of moderation.

cloud models with a zero retention privacy policy are private enough for almost everyone, the subscriptions, google search, ai search engines are either 'buying' your digital life or covering themselves for legal reasons.

you can and should have private cloud services, and if legal agreement is not enough, cryptographic attestation is already used in compute, with AWS nitro enclaves and other providers.

Re: Show HN: Apfel – The free AI already on your Mac

#49

I like the approach of running everything locally. I'm strongly of the opinion that the privacy angle for local models is going to keep getting stronger and more relevant. The amount of articles that come out about accidents happening because of people handing too much context to cloud models the more self reinforcing this will become.

That's the way things have to go. Business risk is too high having everything ran over exposed networks.

what i say about this, is that an llm is just a big file, there is nothing 'not private' about it.

if you are happy with off-prem then the llm is ok too, if you need on-prem this is when you will need local.

Re: Show HN: Apfel – The free AI already on your Mac

#50
As an experiment I built a prototype chatbot app that uses the built-in LLM. It’s got a small context window, but is surprisingly capable and has tool-calling support. Without too much effort I was able to get it to fetch weather data, fetch and summarise emails, read and write reminders and calendar events.
Post reply on HN