Live data from Hacker News

There is minimal downside to switching to open models

marble.onl

191–200 of 351 posts

Re: There is minimal downside to switching to open models

#192
post #107

Earlier quoted context omitted.

> With all the issues in the US and generally wrong direction, I can’t remember them ever arresting people for mean tweets in the way that Germany and the UK have. Then you haven't been paying attention. The constitution prevents citizens from being convicted, but that doesn't stop arrests or being turned away at the border (even for permanent residents who've lived in the US for decades), and US citizens don't seem…

[flagged]

The posts don't even need to be offensive, just uncomfortable:

https://www.fox4news.com/news/woman-arrested-facebook-post-c...

Re: There is minimal downside to switching to open models

#193
What's amazing about these models is they are effectively a distillation of the internet in something that can fit onto your local machine [1] and be queried via natural language.

[1] It seems inevitable that decent local models will be possible as the technology and the hardware is improving at a rate beyond the growth of the knowledge base to be distilled.

Re: There is minimal downside to switching to open models

#194
post #124

Earlier quoted context omitted.

>and US citizens don't seem to care I think maybe you haven't been paying attention. Most of us do care. Trump's approval rating is pretty low at 36%, and his disapproval rating is high. Just because he's still causing chaos doesn't mean the majority of us don't care about it. There's just no legal way to remove him, and his cronies simply won't do it - there's not enough votes in congress or he would have been gone…

I understand your point, however I don’t buy „there's just no legal way to remove him“. With so low ratings where are the daily protests against such type of government? Surely, nationwide daily protests would make elected officials reconsider their positions, given an upcoming midterm election, while there still is one. Don’t get me wrong, I know the thousands reasons why you won’t join a protest, I’m „guilty“ mysel…

Although 36% is low, it's not that low. The US's two-party system means that ~40-50% are aligned with either party and approve/disapprove on GP. The real number to pay attention to is the change over time in the approval rating: https://www.cnn.com/polling/approval/trump-cnn-poll-of-polls

Trump's highest rating was ~47% when he came into office, but he was pretty stably in the low 40s until the new war. The actual drop is somewhere from ~40-42 to ~36-38 - about 10% of his base. Significant, but probably not enough to actually matter unless it drops further.

Re: There is minimal downside to switching to open models

#195
post #188
post #48

Earlier quoted context omitted.

But… the models will fall behind. As libraries and languages and tool calling updates or the world knowledge changes, the models decay. Personally, I don’t like the change, but it’s just how technology works so I’d rather move with the flow than try to stick my foot down and freeze time.

> But… the models will fall behind. Yes but why does that matter? If I am happy with its capabilities now, I will continue being happy with its capabilities in the future. Yes, it cannot do the newest magic shit, but why does that matter? It can still do everything that existed up until that point, which is _a lot_. Eventually, you might also need something new, but it's not like the world shifts over all problems th…

ideally, the software produced should include the latest security patches.

If the model prefers a version of Ruby or node with an RCE, I guess you can burn tokens to teach the model how to avoid the introducing the vulnerability into your code?

That feels quite tedious and token inefficient..

Re: There is minimal downside to switching to open models

#196
post #124

Earlier quoted context omitted.

I understand your point, however I don’t buy „there's just no legal way to remove him“. With so low ratings where are the daily protests against such type of government? Surely, nationwide daily protests would make elected officials reconsider their positions, given an upcoming midterm election, while there still is one. Don’t get me wrong, I know the thousands reasons why you won’t join a protest, I’m „guilty“ mysel…

> Surely, nationwide daily protests would make elected officials reconsider their positions, given an upcoming midterm election, while there still is one. Hah. When was the last time a non-violent protest yielded some kind of result by itself? Certainly never in american history. Anyway, there are daily protests. They just aren't covered by the media. Hell, the protests for palestine never stopped... the media just n…

Women's suffrage was relatively nonviolent.

Re: There is minimal downside to switching to open models

#197
post #195
post #188

Earlier quoted context omitted.

> But… the models will fall behind. Yes but why does that matter? If I am happy with its capabilities now, I will continue being happy with its capabilities in the future. Yes, it cannot do the newest magic shit, but why does that matter? It can still do everything that existed up until that point, which is _a lot_. Eventually, you might also need something new, but it's not like the world shifts over all problems th…

ideally, the software produced should include the latest security patches. If the model prefers a version of Ruby or node with an RCE, I guess you can burn tokens to teach the model how to avoid the introducing the vulnerability into your code? That feels quite tedious and token inefficient..

I'm sorry, but.. are you being serious?

Yes. Yes. The only way one can write secure software is by always using the latest SOTA model. Anything else is inefficient and vulnerable.

I hate this platform

Re: There is minimal downside to switching to open models

#198

I think it's interesting that people write off open weight models because they're "a few months behind" proprietary models. I know LLMs move at the speed of light (especially these past few quarters), but if Opus and GPT "a few months ago" were really like open weight models, then there's really no reason to not switch, especially for those who were using these models a few months ago. Your codebase didn't change, so…

ok but your competition using the latest models has an advantage not all of us are doing noob shit lol

You're being entirely unreasonable. 640 kilobytes of memory was enough for Bill Gates, and yet somehow your special project needs more?

Re: There is minimal downside to switching to open models

#199
I find the attitude shown in this post very surprising. On the one hand, the post starts with a story of adopting Linux and other FOSS. The core of FOSS is giving its users the ability to understand and modify software they run. On the other hand, the rest of the post is about using a tool (LLM) that the author has no way to modify and no way to understand. Huge matrices of floats are at best comparable to compiled code. But the reality is even worse - it’s actually easier to decompile and understand proprietary software. Not to mention the fact the most of the time users can’t even run the “open” models since it requires hardware that most can’t afford.

How did we get from prising software freedoms to this?

Post reply on HN