51–60 of 197 posts
That's fine, I already cancelled my subscription after they admitted to using PEFT to selectively and silently make their models dumber when working in certain technical fields. [ref: section 1.5 of Mythos/Fable 5 system card, https://www-cdn.anthropic.com/d00db56fa754a1b115b6dd7cb2e3c3... ] Maybe that was petty, but I was already looking for alternatives after the obvious angling for increased regulation and suppres…
I should be worried about this, but Anthropic's products are a paid product. You can't use them without providing some identifying information, unless you're going out of your way to provide them inaccurate information. I generally dislike services which require this level of identity verification but also, so far, those have mostly been freemium services and community tools. And I dislike gating those communities. I…
I have no problem paying my groceries with my credit card, but I'd rather not give them a copy of my passport...
I am deeply inconsistent on this.
At this point it's completely outgrageous that the EU, UK, or even Canada can't put forth the funding to develop their own local AI model industry.
More signal that the open-weight models should be our destiny as an industry. These proprietary models are being used to usher in more surveillance and gatekeeping across the industry.
I’m curious (and please forgive my ignorance if it’s obvious), are open weight models practically feasible? I mean from a financial and sustainability standpoint, assuming they’re equally powerful as their proprietary counterparts. I guess I’m trying to understand the economics of it.
More signal that the open-weight models should be our destiny as an industry. These proprietary models are being used to usher in more surveillance and gatekeeping across the industry.
I’m curious (and please forgive my ignorance if it’s obvious), are open weight models practically feasible? I mean from a financial and sustainability standpoint, assuming they’re equally powerful as their proprietary counterparts. I guess I’m trying to understand the economics of it.
You can run fantastic local models if you have either:
- M-series Apple device with ideally >= 24GB of VRAM
- RTX [345]090 GPU
I'm fortunate enough to have both and use an M-series laptop as basically a persistent server (I don't use it much and when traveling typically just use my work laptop). My desktop doesn't act as a persitent server but I fire up llama.cpp on it all time for quick chat sessions.
If you have one of the above devices and can dedicate it as server there are additional layers of tooling you can use that dramatically improve the experience. In particular Open WebUI allows you to add tons of useful tools (image gen, web search, code eval, etc), and agent harnesses like Hermes can make the current gen small models very capable. I have an agent in chat on my phone that basically handles all the sys-admin for the server it runs on.
More signal that the open-weight models should be our destiny as an industry. These proprietary models are being used to usher in more surveillance and gatekeeping across the industry.