Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

There is minimal downside to switching to open models

marble.onl

Post reply on HN
Print view View original

261–270 of 351 posts

Re: There is minimal downside to switching to open models

#261

Post by oefrha »

himata4113 wrote: post #130
coffinbirth wrote: post #70

> Open models are served via various means, some by the companies that released them and some by third parties like OpenRouter. Unfortunately, both of these routes are dodgier in terms of privacy and data sharing, and I would not feel the same comfort sending API calls containing client or confidential data to them. That's why I'm using eurouter.ai with the following routing rule for all my requests: { "model": "glm-…

The part that gets me about anthropic red lines is "of Americans", okay so the rest of the civilized world is up for grabs then? It's okay to destabalize allies with sabotaged tests (in machine learning) and data exfiltration outside America? What gets me the most is that they claim that the model should follow the https://www.anthropic.com/constitution and they claim that it's embedded into the model. However, syste…

> anthropic red lines

Alleged red lines. Could be just talking points for garnering sympathy. Big tech aren’t exactly known for being truthful, especially big tech partnering with esteemed Palantir.

Re: There is minimal downside to switching to open models

#262

Post by justusthane »

Aurornis wrote: post #36

The headline says one thing, then the article text says this: > I’m hoping it’s going to be minimal. I have multiple subscriptions and I pay per token to try out different LLM providers through OpenRouter. I also run open weight models locally. I just can’t agree yet . The models from Anthropic and OpenAI really are that much better than anything else. The open weight models must be universally benchmaxxed across the…

The article also contradicts itself halfway through:

> There remains a clear penalty for being an open LLM user.

The conversation here _around_ the article is interesting, but the article itself boils down to “I’m going to try using open models and hope for the best.”

Re: There is minimal downside to switching to open models

#263

Post by jazzyjackson »

NewsaHackO wrote: post #255
cbolton wrote: post #208

Earlier quoted context omitted.

They can include these limitations in a contract which can be enforced like any contract.

I don't think they can, at least if they are making an argument for why the Defense Production Act should not apply to them. Their original argument is that they will not help with anything that is unconstitutional, such as the unlawful spying on American citizens, without a warrant.

I don’t think Defense Production Act lets the government takeover what you produce, just that if you sell something you have to prioritize selling to the Feds. There is also precedent that code is speech and the government cannot compel speech (this came up during the debacle where FBI wanted a backdoor to unlock iPhones and Apple said no, we’re not building that)

Re: There is minimal downside to switching to open models

#264

Post by baby_souffle »

bob1029 wrote: post #242
pkulak wrote: post #28

Sure. But OpenAI is the same price. Why would I pay $18/month for z.ai when OpenAI is $20/month?

Why pay a monthly fee when you can pay for exactly the # of tokens you actually consume? The API rates are very affordable once you start to optimize for the fact that prepaid tokens seem to massively outperform other kinds of tokens. I can often do with 1 million tokens what my peers have failed to do with 100 million. For me to spend more than $200/m in prepaid API tokens I'd have to pull a 007 work schedule.

> Why pay a monthly fee when you can pay for exactly the # of tokens you actually consume?

Because my 500m tokens so far this month would cost me about $500. My subscription is 100$/month.

Re: There is minimal downside to switching to open models

#266

Post by throwaway27448 »

0xDEAFBEAD wrote: post #229
hdgvhicv wrote: post #117

Earlier quoted context omitted.

https://www.theguardian.com/us-news/ng-interactive/2026/feb/... The age old joke; A Russian and an American are drinking at a bar The Russian says "I'm impressed by american propaganda. It's so subtle but effective." The american responds "What are you talking about, we don't do propaganda."

I'm of the opinion that there is considerably more wailing about US government propaganda than actual US government propaganda. People who reference supposed US government propaganda rarely provide much in the way of concrete examples. Probably because there are legal restrictions on covert propaganda in the US: https://www.law.cornell.edu/wex/covert_propaganda To be clear, I'm happy to grant that: * The Pentagon won…

Have you ever read Manufacturing Consent? A conspiracy is not necessary for wide-spread propaganda campaigns—just a confluence of incentives that act against the common interest (even in the US) but work in the interest of the ruling class.

Re: There is minimal downside to switching to open models

#267

Post by wat10000 »

mopsi wrote: post #240
0xDEAFBEAD wrote: post #229

Earlier quoted context omitted.

I'm of the opinion that there is considerably more wailing about US government propaganda than actual US government propaganda. People who reference supposed US government propaganda rarely provide much in the way of concrete examples. Probably because there are legal restrictions on covert propaganda in the US: https://www.law.cornell.edu/wex/covert_propaganda To be clear, I'm happy to grant that: * The Pentagon won…

"UN Security Council action" is a broad term that can include deployment of international UN-led military forces, as in the Korean War: https://en.wikipedia.org/wiki/United_Nations_Command A few years prior to the Budapest Memorandum, the UN Security Council had authorized military action to liberate Kuwait. 42 countries participated in the coalition that drove Iraqi forces out of Kuwait: https://en.wikipedia.org/wik…

The Budapest Memorandum only requires going to the Security Council if nuclear weapons are involved. There's no required action at all for non-nuclear attacks. This isn't "weaseling over the exact wording," it's just the plain language of the memorandum.

It really amazes me how much misinformation is out there about this thing. It only has six points, each one a single paragraph long. It's very quick and easy to read, yet people apparently can't be bothered to look up the actual text of the thing they're discussing.

Re: There is minimal downside to switching to open models

#268

Post by vonneumannstan »

coffinbirth wrote: post #70

> Open models are served via various means, some by the companies that released them and some by third parties like OpenRouter. Unfortunately, both of these routes are dodgier in terms of privacy and data sharing, and I would not feel the same comfort sending API calls containing client or confidential data to them. That's why I'm using eurouter.ai with the following routing rule for all my requests: { "model": "glm-…

Lol what performative shite. Chinese astroturfing 101. You're either mentally ill or a shill.

Re: There is minimal downside to switching to open models

#269

Post by 0gs »

brucehoult wrote: post #77
marcus_holmes wrote: post #62

Earlier quoted context omitted.

ah, right, so it's about Apple Silicon being fast enough to use instead of a GPU?

They use the GPU but an Apple Silicon GPU has the same high speed access to all the RAM on the machine as the CPU does, rather than having its own walled-off maybe 16 GB VRAM in mainstream gaming GPUs or 24 GB in RTX 4090 or RTX 5090 (MSRP $1999 but in practice $3000-$4000 at the moment). Nvidia A100 (80GB VRAM) apparently cost $15,000 or so. Not only does Apple's unified memory give the GPU more RAM to use, but it a…

i believe you meant something like US$9999 for the 512GB. otherwise, i'm going to feel like QUITE the fool for choosing the 96GB variant at the same price

Re: There is minimal downside to switching to open models

#270

Post by wat10000 »

nxm wrote: post #166
lmm wrote: post #120

Earlier quoted context omitted.

A 30 second search found me https://www.fire.org/news/he-spent-37-days-jail-facebook-pos... . You can beat the rap but you can't beat the ride. (And you're pretty thoroughly proving my point about US citizens not caring about anyone else)

Yay you found a single instance, and more over there are legal means of recourse, unlike the the UK when you’re jailed or fined and that’s it

Don't give a sarcastic reply about finding a single instance, when the request was literally "Please share a single instance." It's just silly.
Post reply on HN