Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Training Stable Diffusion from Scratch Costs <$160k

mosaicml.com

Post reply on HN
Print view View original

11–20 of 52 posts

Re: Training Stable Diffusion from Scratch Costs <$160k

#11

Post by sp332 »

adam_arthur wrote: post #5
gedy wrote: post #3

Still pretty pricey for average person, but these will trend cheaper and why I think it's futile to "regulate" AI. Someone somewhere will train models on anything visible to public, licensed or not. Feels like Pandora's box has been opened and we need to deal with it.

The companies that wait for a 100% "clean" model are going to get left behind. e.g. ChatGPT launching despite Google, Meta and others already having very similar technology internally

There is already a class action lawsuit. The companies that move forward with "dirty" models can be wiped out by legal fees before they got off the ground.

Re: Training Stable Diffusion from Scratch Costs <$160k

#12

Post by anon291 »

gedy wrote: post #3

Still pretty pricey for average person, but these will trend cheaper and why I think it's futile to "regulate" AI. Someone somewhere will train models on anything visible to public, licensed or not. Feels like Pandora's box has been opened and we need to deal with it.

As usual, AI has no agency. I believe we should view AI as simply an extension of our own agency. Thus, if you prompt an AI to generate copyrighted work, that's fine. Viewing it yourself is like imagination. However, just as you can draw mickey mouse for your own fun all you want, you cannot sell such images.

Re: Training Stable Diffusion from Scratch Costs <$160k

#14

Post by operatingthetan »

sp332 wrote: post #11
adam_arthur wrote: post #5

Earlier quoted context omitted.

The companies that wait for a 100% "clean" model are going to get left behind. e.g. ChatGPT launching despite Google, Meta and others already having very similar technology internally

There is already a class action lawsuit. The companies that move forward with "dirty" models can be wiped out by legal fees before they got off the ground.

Doesn't that kind of action cause organizations to be less transparent about the sources of their models then?

Re: Training Stable Diffusion from Scratch Costs <$160k

#15

Post by mullingitover »

Interesting to think about where the cost will go in a few years.

I remember in college intro to CS class back in 1998, where I heard the story of building the first computer that could perform at 1 TFLOPS[1]. It cost $46 million and took up 1600 square feet. Now a $600 Mac Mini will do double that.

[1] https://en.wikipedia.org/wiki/ASCI_Red

Re: Training Stable Diffusion from Scratch Costs <$160k

#16

Post by manimino »

O__________O wrote: post #10
graphe wrote: post #8

I've downloaded anime models for free. I'm sure they were https://github.com/Noah670/stablediffusionAnime

Those models are not from scratch.

It is a fair point though - there's no utility in training an openly available model from scratch. Finetuning is far more practical.

Re: Training Stable Diffusion from Scratch Costs <$160k

#18

Post by DSingularity »

mullingitover wrote: post #15

Interesting to think about where the cost will go in a few years. I remember in college intro to CS class back in 1998, where I heard the story of building the first computer that could perform at 1 TFLOPS[1]. It cost $46 million and took up 1600 square feet. Now a $600 Mac Mini will do double that. [1] https://en.wikipedia.org/wiki/ASCI_Red

And on a much more programmable platform - which is just as important in terms of accessibility !

Re: Training Stable Diffusion from Scratch Costs <$160k

#19

Post by mullingitover »

sp332 wrote: post #11
adam_arthur wrote: post #5

Earlier quoted context omitted.

The companies that wait for a 100% "clean" model are going to get left behind. e.g. ChatGPT launching despite Google, Meta and others already having very similar technology internally

There is already a class action lawsuit. The companies that move forward with "dirty" models can be wiped out by legal fees before they got off the ground.

This will likely just entrench the companies with pockets deep enough to satisfy the lawyers in the class action suits. It might burn down a startup. On the other hand, if Microsoft thinks it's a potential $500 billion business, a $1 billion settlement is just table stakes.

Re: Training Stable Diffusion from Scratch Costs <$160k

#20

Post by Sebguer »

mullingitover wrote: post #19
sp332 wrote: post #11

Earlier quoted context omitted.

There is already a class action lawsuit. The companies that move forward with "dirty" models can be wiped out by legal fees before they got off the ground.

This will likely just entrench the companies with pockets deep enough to satisfy the lawyers in the class action suits. It might burn down a startup. On the other hand, if Microsoft thinks it's a potential $500 billion business, a $1 billion settlement is just table stakes.

This ignores that a legal remedy can be "you can no longer offer this as a product".
Post reply on HN