Earlier quoted context omitted.
The issue is that without loud declaration like this money men will just soldier on with implementing shittier future. It's always do something first and then ask for forgiveness. But at the point you ask for it it's too late and too many eggs were broken. And somehow you're richer at the end of it all and thus, protected from any consequences. While everyone else is, forgive my French, fucked. Has Facebook been a ne…
Ai/ml will change out world. It already does. It's a Paradigma shift and probably the most impactful after the internet. From human to machine interface to medicine, research, content creation etc. No one cares about some dude posting some negative rant like that.
I don't want anything your AI generates
231–240 of 345 posts
Re: I don't want anything your AI generates
#232Earlier quoted context omitted.
The idea that machine learning like large language models and image generating systems exploit labor might be up for debate, but the fact that they are disproportionately damaging to the environment compared to the alternatives is certainly true in the same way that it's true for Bitcoin mining. And there's more than just those two aspects to consider, it's also very much worth considering how the widespread use of s…
> disproportionately damaging to the environment compared to the alternatives This is a new one to me. Do you have any source for that? Once a model is trained, it seems pretty obvious that it takes Dall-E vastly less to create an image than a trained artist. I have trouble believing the training costs are really so large as to change the equation back to favoring humans.
Furthermore, even if there is some decrease in emissions using pre-trained machine learning models over using your own skills and labor, the energy costs of training a powerful machine learning model like you're thinking of are way higher than I think you are imagining. The energy and carbon emission cost of training even a 213M parameter transformer for 3.5 days is 626 times the cost of an average human existing for an entire year according to [this study](https://arxiv.org/abs/1906.02243). Does using a pre-trained machine learning model take that much emission out of people's lives? Or a day's worth out of 228,490 lives, perhaps? I doubt it.
But we aren't even using such a small transformers anymore either — they actually aren't that useful. We're using massive models lile GPT-4, and pushing as hard as we can to scale models even further in a cargo cult faith that making them bigger will fundamentally qualitatively shift their capabilities at some point.
So what does the emissions picture look like for GPT-4? The study above found that emissions costs scale linearly with number of parameters and tuning steps as well as training time, so we can make a back of the napkin estimate that GPT-4 is 8,592,480 times more expensive to train than the transformer used in the study, since it is rumored to have 1.76 trillion parameters versus the 213 million of the model in the study, and GPT-3 was said to take 3640 days to train (despite using insane amounts of simultaneous compute to scale the compute up in conjunction with the scale of the model) versus 3.5 days. This in turn means it is 5,378,892,480 times more expensive to train a GPT-4 than it is for a human to live for one year. And again, to reiterate, no matter what work the humans are doing, they're going to be living for around the same amount of time and using roughly the same amount of carbon emissions as long as they're not like taking cross country or transatlantic flights or something. So it's more expensive to train gpt4 then it is for almost 6 billion people to live for a year. I don't think it's taking a year's worth of emissions off of 6 billion people's lives by being slightly more convenient than having to type some things in or draw some art yourself. And there are only 8 billion people on the planet, so I don't think there's enough people to spread smaller gains out across to justify the training of this model (you'd have to take a days worth of emissions off of 1,963,295,755,200 people to offset that training cost!), especially since in my opinion the decrease in emissions of using machine learning models would necessarily be absolutely miniscule.
Re: I don't want anything your AI generates
#233Earlier quoted context omitted.
The idea that machine learning like large language models and image generating systems exploit labor might be up for debate, but the fact that they are disproportionately damaging to the environment compared to the alternatives is certainly true in the same way that it's true for Bitcoin mining. And there's more than just those two aspects to consider, it's also very much worth considering how the widespread use of s…
how's it more damaging to the environment of you can replace 1k people, that's 1k people staying at home instead of commuting, sure that causes pain if we can't figure out ubi or a way to house and feed the masses, also many of the biggest ai users are working to get their energy 100 percent from solar, wind, and geothermal. AI is something we've been heading towards since the dawn of man. Hell, ancient Rome had auto…
Check my comment above, where I do some rough back of the napkin calculations around this. Training gpt4 for example produced around 6 billion times the carbon emissions a human emits in total in a year, which probably includes commuting, so unless gpt4 removes the commute time of probably a significant fraction more than 6 billion people (since it wouldn't be eliminating their emissions entirely, just their commuting emissions) it is a net loss. Also, we can eliminate commute emissions by having better public transportation and walkable/bikable cities, we don't need to prostrate ourselves before a dementia addled machine God to get there.
Re: I don't want anything your AI generates
#234Earlier quoted context omitted.
> As a form of fair use, models learn styles of art or writing the same way humans do - by seeing lots of examples. It is possible to create outputs that are very similar to existing works, just as a human painter could copy a famous painting. The issue there lies in the output, not the human/model. I've seen this analogy parroted everywhere and it's garbage. Show me a human being that, in an afternoon, can study the…
> Show me a human being that, in an afternoon, can study the art of Rembrandt and from that experience, paint plausibly Rembrandt style paintings in a few minutes each, and I'll swear by AI for the rest of my life. So it's okay to learn, but only if you do it very slowly? I surely don't need to point you to the existence of forgers - you know a human can study the art of Rembrandt and paint plausibly Rembrandt style…
No, it's a fundamentally different process with different results. An artist learns from previous artists to express things they themselves want to express. An AI digests art to become a viable(ish) tool for people who want to express themselves, as long as that expression resides somewhere in the weighted averages of the art the model has digested. Two fundamentally different things, apples and oranges, and, also not without it's own set of limitations. Despite the rhetoric around this stuff that anyone can create anything, that's just not true: you can create anything that you can find a model that's suitable to create it, that was itself trained on a LOT of similar material to what you want to create. Effectively automated ultra-fine scrap-booking.
Honestly if creativity is your thing, even if you find creating difficult for whatever accessibility reason you feel like pretending you care about, you will find AI more frustrating than anything, and the bounds of your creativity are the model itself, and the safeguards whatever provider has decided are important to put in place. You've just exchanged one set of limitations you probably can't control for another set you definitely can't control.
> I surely don't need to point you to the existence of forgers - you know a human can study the art of Rembrandt and paint plausibly Rembrandt style paintings
Yes and those are worthless once found, just like AI art. And again, you've sidestepped the scale: Adobe Firefly can bash out 3 images in roughly 2 minutes of solid resolution. No human can even dream of getting close to creating Rembrandt forgeries at that rate.
> We have been doing that since the dawn of history - what makes this any different from cars obsoleting the horse drawn carriage?
Because cars costed a fortune when new and were toys for the wealthy, before Henry Ford came along some three decades later to fix that. And then, the former farriers had time to retrain for new work. Not to mention, carriage builders were still employed through many decades with the rise of cars, because originally buying a "car" meant you got a chassis, suspension, engine and the essentials, which you would then take to a coach builder to have a "skin" if you will build around it. Hence the term "coachwork."
> Computers have been automating people's jobs for decades - should we ban programming writ large?
Is this the "debate" you were saying you were open to? Hyperbolic statements with zero substance? I can see why few want to have it with you.
> Where, exactly, do you feel the line ought to be drawn?
Consent. Tons of people's creative output was used to build machines to replace them, without their consent and more often than not, explicitly against their wishes, under the guise of a "research project" and not a monetized tech product. Once again a tech company bungles into the public square, exploits it for money, then makes us live with the consequences. I frankly think that question aught to be reversed: what makes OpenAI entitled to all that content, for a purpose it was never meant for, with zero permission or consent on the part of it's creators?
I'm not opposed to ML as a concept. It has it's uses, even for generating images/writing/what have you. But these models as they exist now are poisoned with reams of unethically sourced material. If any of these orgs gave even the slightest shit about ethics, they'd dump them and re-train them with only material from those who consented to have it used that way. Simple as.
Re: I don't want anything your AI generates
#235What about AI-generate educational content? We use AI-generated voice calls to teach languages, e.g. immigrants get to practice speaking a new language without paying for a human tutor.
Re: I don't want anything your AI generates
#236Earlier quoted context omitted.
Ai/ml will change out world. It already does. It's a Paradigma shift and probably the most impactful after the internet. From human to machine interface to medicine, research, content creation etc. No one cares about some dude posting some negative rant like that.
"Change the world" and "paradigm shift" are not inherently good.
Doesn't matter though if we like it or not because it's happening.
The only thing preventing this is a total economy collapse so crazy that our society doesn't continue chip production.
Re: I don't want anything your AI generates
#237Earlier quoted context omitted.
I wonder what he feeds the AI. Maybe some nice concise bullet points, which are what you’d probably want. Maybe we’ll end up with dual layers of AI: one to expand out top-down requests, another to compress them to something efficient to read. We can also have engineers prompt the AI: write me a weekly status report on what I did. Here are my git commit logs and jira points. Emphasize (some topic). Then the owners can…
I read an article about this sometime last year. Basically AI is the exact opposite of compression. We take what should be a few bullet points, turn it into some overly wordy bullshit with AI, then the recipient uses AI to turn that wordy bullshit back into a few bullet points. And it costs a ton of compute to do this. Kind of insane. I hope society evolves to work smarter.
Re: I don't want anything your AI generates
#238Feels like "crypto" where if someone says "I am not interested", "I do not like it", or something to that effect then commenters suddenly appear suggesting that this is somehow unacceptable. Look at the top comment. Like crypto, it seems some folks have bet on "AI", and are spooked by any hint of skepticism.
Re: I don't want anything your AI generates
#239Anytime someone sends me something generated by ChatGPT, I think about how AI expert Hilary Mason puts it: "By design, ChatGPT aspires to be the most mediocre web content you can imagine." https://nwn.blogs.com/nwn/2023/03/chatgpt-explained-hilary-m...
This resonates with my experience using Copilot. It generates lowest-common-denominator code, and displays a stunning unawareness of language and library features. Some understandable due to training cutoff (but still very frustrating), but it also refused to use Pillow functions that seem to have been around for a decade, instead crufting together some shitty pipeline by hand.