111–120 of 267 posts
Impressive model, for sure. I've been running it on my Mac, now I get to have it locally in my iPhone? I need to test this. Wait, it does agent skills and mobile actions, all local to the phone? Whaaaat? (Have to check out later! Anyone have any tips yet?) I don't normally do the whole "abliterated" thing (dealignment) but after discovering https://github.com/p-e-w/heretic , I was too tempted to try it with this mode…
Earlier quoted context omitted.
> It's widely understood that the big players are making profit on inference. Are they? Or are they just saying that to make their offerings more attractive to investors? Plus I think most people using agents for coding are using subscriptions which they are definitely not profitable in. Locally running models that are snappy and mostly as capable as current sota models would be a dream. No internet connection requir…
> Plus I think most people using agents for coding are using subscriptions which they are definitely not profitable in. Where on earth do people get this idea? Subscriptions that are based around obscure, vendor defined "credits" are the perfect business model for vendors. They can change the amount you can use whenever they want. It's likely they occasionally make a loss on some users but in general they are highly…
Earlier quoted context omitted.
>there's a whole set of ethically-justifiable but rule-flagging conversations (loosely categorizable as things like "sensitive", "ethically-borderline-but-productive" or "violating sacred cows") that are now possible with this, and at a level never before possible until now. Mind giving us a few of the examples that you plan to run in your local LLM? I am curious.
I'm not sure what you're angling at but I already gave a set of questions that are ethically legitimate yet routinely censored by the public models: https://news.ycombinator.com/item?id=47654013 Not to mention that doing what the big model makers do literally dumbs the model down. They should at least allow something like letting you prove your age and identity to give you access to better/unaligned models, maybe eve…
This is also on Android and has an option to use AICore with the NPU which can run much faster than even the GPU models.
Earlier quoted context omitted.
That happened already, in typical ai fashion: blatant theft https://www.nbcnews.com/tech/scarlett-johansson-legal-action...
[flagged]
That’s like using someone’s face in an app and then saying “how can you steal pixels?”