Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

MSFT's WizardLM2 models have been taken down

huggingface.co

Post reply on HN
Print view View original

21–29 of 29 posts

Re: MSFT's WizardLM2 models have been taken down

#21

Post by latexr »

haolez wrote: post #13
calebrob6 wrote: post #9

Earlier quoted context omitted.

It looks like it needs to go through toxicity testing -- https://twitter.com/WizardLM_AI/status/1780101465950105775

I can't imagine how toxicity in a LLM can be harmful. Can't we write stories with toxic characters, for example? It feels like the greatest minds of our era are creating an amazing piece of technology. And we are hindering it in the name of corporate cover ass and bullshit jobs.

> It feels like the greatest minds of our era are

This is the new “we could put a man on the moon, yet…”. No, “the greatest minds of our era” are not working in adtech or building LLMs. It’s easy to forget, but there is a whole world outside of computers, and being good at it does not equate to being “a great mind”. It is absurd to believe the greatest minds are all working around the same problem spaces.

Re: MSFT's WizardLM2 models have been taken down

#22

Post by 95014_refugee »

haolez wrote: post #13
calebrob6 wrote: post #9

Earlier quoted context omitted.

It looks like it needs to go through toxicity testing -- https://twitter.com/WizardLM_AI/status/1780101465950105775

I can't imagine how toxicity in a LLM can be harmful. Can't we write stories with toxic characters, for example? It feels like the greatest minds of our era are creating an amazing piece of technology. And we are hindering it in the name of corporate cover ass and bullshit jobs.

If you think that you want to live in a world where your life is heavily influenced by machines that were trained on the idea that you don’t deserve to exist, then yes, “toxicity” isn’t a problem.

But you don’t think that. Even if you think you do.

Re: MSFT's WizardLM2 models have been taken down

#23

Post by haolez »

latexr wrote: post #21
haolez wrote: post #13

Earlier quoted context omitted.

I can't imagine how toxicity in a LLM can be harmful. Can't we write stories with toxic characters, for example? It feels like the greatest minds of our era are creating an amazing piece of technology. And we are hindering it in the name of corporate cover ass and bullshit jobs.

> It feels like the greatest minds of our era are This is the new “we could put a man on the moon, yet…”. No, “the greatest minds of our era” are not working in adtech or building LLMs. It’s easy to forget, but there is a whole world outside of computers, and being good at it does not equate to being “a great mind”. It is absurd to believe the greatest minds are all working around the same problem spaces.

Fair, but that's not central to my argument. My point still holds.

Re: MSFT's WizardLM2 models have been taken down

#24

Post by haolez »

95014_refugee wrote: post #22
haolez wrote: post #13

Earlier quoted context omitted.

I can't imagine how toxicity in a LLM can be harmful. Can't we write stories with toxic characters, for example? It feels like the greatest minds of our era are creating an amazing piece of technology. And we are hindering it in the name of corporate cover ass and bullshit jobs.

If you think that you want to live in a world where your life is heavily influenced by machines that were trained on the idea that you don’t deserve to exist, then yes, “toxicity” isn’t a problem. But you don’t think that. Even if you think you do.

But instead, they are trained on what some corporation or government thinks is good for me. How's that any better? Do you trust them to be neutral and act in your best interest? Who defined toxicity?

A "neutral" policy here is probably a still unsolved philosophy problem.

Re: MSFT's WizardLM2 models have been taken down

#25

Post by haolez »

mistrial9 wrote: post #15
haolez wrote: post #13

Earlier quoted context omitted.

I can't imagine how toxicity in a LLM can be harmful. Can't we write stories with toxic characters, for example? It feels like the greatest minds of our era are creating an amazing piece of technology. And we are hindering it in the name of corporate cover ass and bullshit jobs.

if you read the large theory papers on human-computer LLM interfaces, the people who build these are genuinely worried about "harm" . Impolitely, it appears from the outside that the kind of researchers that they have attracted over a decade to do this fantastically tedious and abstract work, are covered in emotional illness symptoms personally, and developed a culture of incessantly declaring "harm" in every shadow…

That's another point, but I agree. The government's incentives are to become bigger and more powerful. LLM control could be a fast lane to become a totalitarian state. Governments around the world might not do that by choice, but the incentive is true and is present.

Re: MSFT's WizardLM2 models have been taken down

#27

Post by spuzz »

95014_refugee wrote: post #22
haolez wrote: post #13

Earlier quoted context omitted.

I can't imagine how toxicity in a LLM can be harmful. Can't we write stories with toxic characters, for example? It feels like the greatest minds of our era are creating an amazing piece of technology. And we are hindering it in the name of corporate cover ass and bullshit jobs.

If you think that you want to live in a world where your life is heavily influenced by machines that were trained on the idea that you don’t deserve to exist, then yes, “toxicity” isn’t a problem. But you don’t think that. Even if you think you do.

You can't even define toxicity in an objective and verifiable way, because it's inherently subjective.

Trying to make rules for a machine to behave in a decidedly nontoxic way is a fool's errand, then.

You're also assuming that AI is going to be used to heavily influence people's lives, but there's a good chance that all it's good for is ripping off copyrighted material and generating clipart that's good enough for powerpoint presentations.

AI is probably going to change the world in the way that NFTs did. And self driving cars. And the Alexa.

Re: MSFT's WizardLM2 models have been taken down

#28

Post by qball »

95014_refugee wrote: post #22
haolez wrote: post #13

Earlier quoted context omitted.

I can't imagine how toxicity in a LLM can be harmful. Can't we write stories with toxic characters, for example? It feels like the greatest minds of our era are creating an amazing piece of technology. And we are hindering it in the name of corporate cover ass and bullshit jobs.

If you think that you want to live in a world where your life is heavily influenced by machines that were trained on the idea that you don’t deserve to exist, then yes, “toxicity” isn’t a problem. But you don’t think that. Even if you think you do.

I already live in this world. That is why I don't want my models censored; they're already spewing that toxicity.

(It's just your brand of toxicity, so naturally, you don't think it's a problem.)

Re: MSFT's WizardLM2 models have been taken down

#29

Post by clemyjontri »

tmearnest wrote: post #17
null_point wrote: post #12

Earlier quoted context omitted.

Toxicity testing? That a self-imposed requirement by Microsoft?

I don’t think they forgot about Tay. https://spectrum.ieee.org/in-2016-microsofts-racist-chatbot-...

I asked GPT-4 to rewrite the refrain from Eminem's "Forgot about Dre" but change it to "Forgot about Tay" and make it all about chatbots... this is the best one it came up with:

Nowadays, every bot wanna chat

Like they got something to say, but these LLMs

Are too toxic to use, just a waste of GPUs

And the programmers act like they forgot about Tay.

Post reply on HN