Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

S1: A $6 R1 competitor?

timkellogg.me

Post reply on HN
Print view View original

341–350 of 430 posts

Re: S1: A $6 R1 competitor?

#341

Post by danans »

pjc50 wrote: post #337
zoogeny wrote: post #192

Earlier quoted context omitted.

This is something I have been suppressing since I don't want to become chicken little. Anyone who isn't terrified by the last 3 months probably doesn't really understand what is happening. I went from accepting I wouldn't see a true AI in my lifetime, to thinking it is possible before I die, to thinking it is possible in in the next decade, to thinking it is probably in the next 3 years to wondering if we might see i…

This frightens mostly people whose identity is built around "intelligence", but without grounding in the real world. I've yet to see really good articulations of what, precisely we should be scared of. Bedroom superweapons? Algorithmic propaganda? These things have humans in the loop building them. And the problem of "human alignment" is one unsolved since Cain and Abel. AI alone is words on a screen. The sibling thr…

> without grounding in the real world.

> I've yet to see really good articulations of what, precisely we should be scared of. Bedroom superweapons?

Loss of paid employment opportunities and increasing inequality are real world concerns.

UBI isn't coming by itself.

Re: S1: A $6 R1 competitor?

#342

Post by downrightmike »

eru wrote: post #317
advael wrote: post #277

I'm strictly speaking never going to think of model distillation as "stealing." It goes against the spirit of scientific research, and besides every tech company has lost my permission to define what I think of as theft forever

At most it would be illicit copying. Though it's poetic justice that OpenAI is complaining about someone else playing fast and loose with copyright rules.

The First Amendment is not just about free speech, but also the right to read, the only question is if AI has that right.

Re: S1: A $6 R1 competitor?

#343

Post by pjc50 »

danans wrote: post #341
pjc50 wrote: post #337

Earlier quoted context omitted.

This frightens mostly people whose identity is built around "intelligence", but without grounding in the real world. I've yet to see really good articulations of what, precisely we should be scared of. Bedroom superweapons? Algorithmic propaganda? These things have humans in the loop building them. And the problem of "human alignment" is one unsolved since Cain and Abel. AI alone is words on a screen. The sibling thr…

> without grounding in the real world. > I've yet to see really good articulations of what, precisely we should be scared of. Bedroom superweapons? Loss of paid employment opportunities and increasing inequality are real world concerns. UBI isn't coming by itself.

Sure, but those are also real world concerns in the non-AI alternate timeline. As is the unlikelihood of UBI.

Re: S1: A $6 R1 competitor?

#344

Post by danans »

lodovic wrote: post #268
immibis wrote: post #229

Earlier quoted context omitted.

Those people will simply be surplus to requirements. They'll be left alone as long as they don't get in the way of the ruling class, and disposed of if they do. As usual in history.

That's a fallacy. You can't have an advanced economy with most people sitting on the side. Money needs to keep flowing. If all that remains of the economy consists of a few datacenters talking to each other, how can the ruling class profit off that?

> Money needs to keep flowing. If all that remains of the economy consists of a few datacenters talking to each other, how can the ruling class profit off that?

Plenty of profit was made off feudalism, and technofeudalism has all the tools of modern technology at its disposal. If things go in that direction, they will have an unlimited supply of serfs desperate for whatever human work/livelihood is left.

Re: S1: A $6 R1 competitor?

#346

Post by danans »

pjc50 wrote: post #343
danans wrote: post #341

Earlier quoted context omitted.

> without grounding in the real world. > I've yet to see really good articulations of what, precisely we should be scared of. Bedroom superweapons? Loss of paid employment opportunities and increasing inequality are real world concerns. UBI isn't coming by itself.

Sure, but those are also real world concerns in the non-AI alternate timeline. As is the unlikelihood of UBI.

Yes, but they are likely dramatically accelerated in the AI timeline.

Re: S1: A $6 R1 competitor?

#347

Post by ziofill »

MR4D wrote: post #259
xg15 wrote: post #175

Earlier quoted context omitted.

I think the fact alone that distillation and quantization are techniques that can produce substantial improvements is a strong sign that we still have no real comprehensive understanding how the models work. If we had, there would be no reason to train a model with more parameters than are strictly necessary to represent the space's semantic structure. But then it should be impossible for distilled models with less p…

I like the analogy of compression, in that a distilled model of an LLM is like a JPEG of a photo. Pretty good, maybe very good, but still lossy. The question I hear you raising seems to be along the lines of, can we use a new compression method to get better resolution (reproducibility of the original) in a much smaller size.

What you say makes sense, but is there the possibility that because it’s compressed it can generalize more? In the spirit of bias/variance.

Re: S1: A $6 R1 competitor?

#348

Post by mettamage »

mettamage wrote: post #93
davely wrote: post #67

Earlier quoted context omitted.

I think we need to wait for someone to convert it into a GGUF file format. However, once that happens, you can run it (and any GGUF model) from Hugging Face![0] [0] https://huggingface.co/docs/hub/en/ollama

So this? https://huggingface.co/brittlewis12/s1-32B-GGUF

I ran it, so far it seems like a pretty good model, especially locally.

Re: S1: A $6 R1 competitor?

#349

Post by soco »

palmotea wrote: post #336
kortilla wrote: post #316

Earlier quoted context omitted.

> The only people our society and economy really values are the elite with ownership and control This isn’t true. The biggest companies are all rich because they cater to the massive US middle class. That’s where the big money is at.

> This isn’t true. The biggest companies are all rich because they cater to the massive US middle class.. It is true, but I can see why you'd be confused. Let me ask you this: if members of the "the massive US middle class" can be replaced with automation, are those companies going 1) to keep paying those workers to support the middle-class demand which made them rich, or are they going to 2) fire them so more money…

So you end up with a huge starved mob trying to come all over your mansions and islands. I somehow think Musk totally capable of nuking those mobs, or unleash the (future) AI dogs over them, because the mob cannot produce anymore (because of AI) and cannot pay anymore (because no jobs because of AI). So the mob will be totally worthless to this style of "capitalism". Really why would they bother with UBI when they can let the mob just die out?

Re: S1: A $6 R1 competitor?

#350

Post by soco »

danans wrote: post #344
lodovic wrote: post #268

Earlier quoted context omitted.

That's a fallacy. You can't have an advanced economy with most people sitting on the side. Money needs to keep flowing. If all that remains of the economy consists of a few datacenters talking to each other, how can the ruling class profit off that?

> Money needs to keep flowing. If all that remains of the economy consists of a few datacenters talking to each other, how can the ruling class profit off that? Plenty of profit was made off feudalism, and technofeudalism has all the tools of modern technology at its disposal. If things go in that direction, they will have an unlimited supply of serfs desperate for whatever human work/livelihood is left.

Unlimited supply yes, but highly limited usage for them. So even if a few will work for free, the rest will be starving, and angry.
Post reply on HN