Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: Apfel – The free AI already on your Mac

apfel.franzai.com

Post reply on HN
Print view View original

111–120 of 180 posts

Re: Show HN: Apfel – The free AI already on your Mac

#112

Post by gigatexal »

bombcar wrote: post #23
gigatexal wrote: post #14

It’s a very small model but I’ve been playing with it for some time now I’m impressed. Have we been sleeping on Apple’s models? Imagine they baked Qwen 3.5 level stuff into the OS. Wow that’d be cool.

Apparently the Overcast guy build a beowulf cluster of Mac minis to use the Apple transcription service. https://www.linkedin.com/posts/nathangathright_marco-arment-...

Yeah heard him talk about that. 48 or so 16GB m4 Mac minis. Insane. The Beowulf lives

Re: Show HN: Apfel – The free AI already on your Mac

#116

Post by wrxd »

cousin_it wrote: post #88
convexly wrote: post #29

I like the approach of running everything locally. I'm strongly of the opinion that the privacy angle for local models is going to keep getting stronger and more relevant. The amount of articles that come out about accidents happening because of people handing too much context to cloud models the more self reinforcing this will become.

It's only half of the solution though. If the models are trained in a closed way, they can prioritize values encoded during training even if that's not what you want (example: ask the open Chinese models about Tiananmen). It's not beyond imagining that these models would e.g. try to send your data to authorities or advertisers when their training says so, even if you run them locally. So the full solution would be mo…

The model is only generating tokens without touching the network at all, right? How would it send data away?

Re: Show HN: Apfel – The free AI already on your Mac

#118

Post by xandrius »

furyofantares wrote: post #97

Looks like a nice wrapper around the APIs. Extremely oversold landing page, very marketing heavy for what it is. You can actually make nice looking landing pages that are about 10% the size of this and more straightforward, rather than some mimicry of a SaaS that's trying desperately to sell you something. Makes it easier for you to review the content for factuality too, and heck you couldn't even take ownership of s…

It's absolutely free and open source, no need to bash it like this.

Re: Show HN: Apfel – The free AI already on your Mac

#119

Post by procaryote »

wrxd wrote: post #116
cousin_it wrote: post #88

Earlier quoted context omitted.

It's only half of the solution though. If the models are trained in a closed way, they can prioritize values encoded during training even if that's not what you want (example: ask the open Chinese models about Tiananmen). It's not beyond imagining that these models would e.g. try to send your data to authorities or advertisers when their training says so, even if you run them locally. So the full solution would be mo…

The model is only generating tokens without touching the network at all, right? How would it send data away?

Theoretically, by taking the opportunity to inject an exfiltration mechanism if you ask it to write code for you

Re: Show HN: Apfel – The free AI already on your Mac

#120

Post by [deleted] »

reaperducer wrote: post #100
frontsideair wrote: post #94

> Apple locked it behind Siri. apfel sets it free This doesn't feel truthful, it sounds like this tool is a hack that unlocks something. If I understand it correctly, it's using the same FoundationModels framework that powers Apple Intelligence, but for CLI and OpenAI compatible REST endpoint. Which is fine, just the marketing goes hard a bit. > Runs on Neural Engine Also unsure if this runs on ANE, when I tried Appl…

[flagged]

[deleted]
Post reply on HN