Provable quality human curation has always been valuable, but hard to identify. It's becoming a smaller slice of the pie as it fills up with AI slop. Good time for newsletters and podcasts to be out in force if the higher quality content can be identified.
AI Slop Is Flooding Medium
61–70 of 76 posts
Re: AI Slop Is Flooding Medium
#62Hey it's me, Max. I ran the analysis for WIRED and got them their initial 47% number for AI content. The CEO accused me of trying to extort him because I sent a short email with our findings prior to the publication of this article. He also casts doubt on the efficacy of AI detection (fair) but I think our AI detection model is orders of magnitude more accurate than the others and I stand by its predictions.
What gives you confidence in this AI detection model?
We benchmark on pre-2023 datasets of O(10M) documents not in our training set. Other detectors seem to have between 1-3% false positive rate and ours is around 1 in 10,000 as of our latest model update. We do a lot of active learning + core set selection to keep FPR low and improve recall on larger LLMs. Our white paper with some methodology is here: https://arxiv.org/abs/2402.14873
Re: AI Slop Is Flooding Medium
#63Previously, spam has been reported and filtered via "flag" and "report" buttons. Why is that not sufficient for site operators to separate "AI Slop" from other articles? If existing sites choose to tolerate "AI Slop" (why doesn't HN have this problem?), does that create a market opportunity for competitors with better filters?
> why doesn't HN have this problem?
Because it's already filled with russian bots.
Re: AI Slop Is Flooding Medium
#64I’ve come to simply realize the problem isn’t AIs, it’s humans.
More specifically, humans who feel the need to make a quick buck.
Actually, the problem isn’t those humans, it’s the societal structure creating incentives and pressures that lead to a large percentage of humans feeling like they need to make a quick buck. Whether that quick buck be for cost of living or for social status gain.
Re: AI Slop Is Flooding Medium
#65Definitely not just Medium. It's everywhere. I have noticed that someone immediately calls out pretty much every bit of content as AI generated, whether it obviously is or not. I guess this is a best case scenario. I do wonder what will spring up next to allow high quality content to be found.
True, I'm always making sure my Kindle is face down when I'm not using it so that my coworkers don't think I'm reading whatever insane AI slop Title Amazon happens to be advertising to me at the moment. I really don't see how these people making the ebooks are making any money on these books either since they cost 99 cents and they pay for advertising. Maybe they're using llama2 idk lmao, either way I've seen a ton o…
jail broke mine years ago and never allowed it online again. I do not tolerate ads on a device I bought.
Re: AI Slop Is Flooding Medium
#66Earlier quoted context omitted.
Perhaps I'm naive or old fashioned, but I prefer this unpolished version. You clearly have an unclosed parenthesis that's attached to a rough sentence, but two minutes of rephrasing will serve you well in improving both your writing and your speech. If you must use it, I'd suggest asking for suggestions rather than rewrites. Writing is not just about syntax, but also about communicating who you are. This is your true…
Thank you—I understand where you're coming from. My interest in using GenAI stems from its ability to catch subtle implications or unintended double meanings in my writing. I've had plenty of "that's not what I meant" moments in the past, so using AI helps me align my phrasing with my true intent. It offers an objective lens, making it easier for me to convey my thoughts clearly, especially since I sometimes find it…
Fair enough. If you ever decide to do the proofreading yourself, you may find a prompt like this useful:
"Consider the following message. Distill the main thrust of the message, and list any implied statements made within. Be particularly sensitive to any negative connotations, and summarize the writer's feelings towards the reader:"
Re: AI Slop Is Flooding Medium
#67tbh Medium was slop long before AI slop
Medium was flooded with human-created slop before OpenAI got big. I work in Spark a lot, and basically every question I put into Google has a few lame Medium articles that basically recap the docs or have some trivial example code. Ironically, I turn to Claude now as my primary source. It's very good at Spark.
Re: AI Slop Is Flooding Medium
#68I’ve come to simply realize the problem isn’t AIs, it’s humans. More specifically, humans who feel the need to make a quick buck. Actually, the problem isn’t those humans, it’s the societal structure creating incentives and pressures that lead to a large percentage of humans feeling like they need to make a quick buck. Whether that quick buck be for cost of living or for social status gain.
I'm sure there are thousands of resumes out there with a Medium blog URL on them, which probably impresses HR but not so much if you actually read them. It's all just another way to "build your personal brand".
Re: AI Slop Is Flooding Medium
#69I've seen this on Substack as well. For example, I ran across this account on Substack is posting a lot of ChatGPT-generated articles to reddit. This is clearly ChatGPT-generated based on a very simple prompt: https://theglobalistperspective.substack.com/p/the-rise-of-i...
It's full of anecdotes from apparently real individuals. Are these rewrites of content scraped from real news?
I think they give it the URL of the original article and ask it to re-write it with a specific political slant.
Re: AI Slop Is Flooding Medium
#70Currently on ChatGPT three of the top picks on the explore page are "AI Humanizers" for making generated content appear like it was created by a human. Slop slop slop.
So, the progression is:
* humans creating things
* algorithms emulating (humans creating things)
* human-in-the-loop guiding (algorithms emulating (humans creating things))
* ai that mimics the (human-in-the-loop guiding (algorithms emulating (humans creating things)))
* what next???