Live data from Hacker News

The trust collapse: Infinite AI content is awful

arnon.dk

81–90 of 218 posts

Re: The trust collapse: Infinite AI content is awful

#81
post #72

I wish we were talking about what's next versus what's increasingly here. How can infinite AI content be strictly awful if it forces us to fix issues with our trust and reward systems? Short term, sure. But infinite (also) implies long term. I wish I had a really smart game theorist friend who could help me project forward into time if for nothing other than just fun. Don't get me wrong, I'm not trying to reduce the…

From a game-theory perspective, if players rush the field with AI-generated content because it's where all the advantages are this year, then there's going to be room on the margins for trust-signaling players to advance themselves with more obviously handspun stuff. Basically, a firm handshake and an office right down the street. Lunches and golf. The real question to ask in this gold rush might be what kind of shov…

Long airlines and corporate credit cards

Re: The trust collapse: Infinite AI content is awful

#82
post #71

Doesn't matter. We must keep building more and more technology no matter the cost. Have an idea for a business? Build it. Does your business make the lives of people worse? Doesn't matter, keep pushing. Could some new technology ruin the lives and relationships that people have? Doesn't matter, just build it. We always need more, need to do more. Every experiment is valid, every impulse must be followed. More complex…

One of the potential upsides to this as that people just might start taking time to engage in a bit of critical thinking before reacting. Is this real? How likely is this AI nonsense? What is the source? Is this the full picture? etc. Perhaps I am too optimistic...

Neil deGrasse Tyson said a quote expressing a concern about the future impact of AI on information credibility.

The exact quote is: "I foresee the day where AI become so good at making a deep fake that the people who believed fake news as true will no longer think their fake news is true because they'll think their fake news was faked by AI."

Re: The trust collapse: Infinite AI content is awful

#84

Trust collapse is real, I don't trust anything anymore. Take this article for instance, I don't trust it because of the random bolding. Does that mean it's AI generated? I don't know but I've seen lots of AI generated content and it has random bolding, so when I see it, I immediately don't trust it. And I don't have the time to verify anything, so whether or not this article was written by the author or AI, it's gone…

Well said. Sad how that reflex starts kicking in for HN comments as well (ps I'm not getting any signals from your comment).

Re: The trust collapse: Infinite AI content is awful

#85
post #12

Yuval Noah Harari, Sapiens fame [0], has a great quote (paraphrasing): Interviewer: How will humans deal with the avalanche of fake information that AI could bring? YNH: The way humans have always dealt with fake information: by building institutions we trust to provide accurate information. This is not a new phenomenon btw. In democracies, this is often either the government (e.g. the Bureau of Labor Statistics) or…

The problem is that too many people just don't know how to weigh different probabilities of correctness against each other. The NYT is wrong 5% of the time - I'll believe this random person I just saw on TikTok because I've never heard of them ever being wrong; I've heard many stories about doctors being wrong - I'll listen to RFK; scientific models could be wrong, so I'll bet on climate change being not real etc.

Once a problem demands second order thinking you immediately lose a significant portion of the population.

It’s simply reality, or else propaganda wouldn’t work so well.

Re: The trust collapse: Infinite AI content is awful

#86
post #72

I wish we were talking about what's next versus what's increasingly here. How can infinite AI content be strictly awful if it forces us to fix issues with our trust and reward systems? Short term, sure. But infinite (also) implies long term. I wish I had a really smart game theorist friend who could help me project forward into time if for nothing other than just fun. Don't get me wrong, I'm not trying to reduce the…

From a game-theory perspective, if players rush the field with AI-generated content because it's where all the advantages are this year, then there's going to be room on the margins for trust-signaling players to advance themselves with more obviously handspun stuff. Basically, a firm handshake and an office right down the street. Lunches and golf. The real question to ask in this gold rush might be what kind of shov…

That gets my brain moving, thanks. What do you think those who are poor/rich in a trust economy look like? How much of a transformation to trust economy do you think we make?

Re: The trust collapse: Infinite AI content is awful

#87
post #68

Earlier quoted context omitted.

People want dopamine hints, gamification, addictive distractions, and a culture of competitive perma-hustle. If they didn't, we wouldn't be having these problems. The problem isn't AI, it's how marketing has eaten everything. So everyone is always pitching, looking for a competitive advantage, "telling their story", and "building their brand." You can't "build trust" if your primary motivation is to sell stuff to you…

If they didn't, we wouldn't be having these problems. That assumes people have the ability to choose not to do these things, and that they can't be manipulated or coerced into doing them against their will. If you believe that advertising, especially data-driven personalised and targeted advertising, is essentially way of hacking someone's mind to do things it doesn't actually want to do, then it becomes fairly obvio…

There are times I need a widget but I don't know it exists and so someone needs to inform me. Other times I know I need a widget, but I don't know about Acme and I will want to check them out too before buying.

Most ads are just manipulating me, but there are times I need the thing advertised if only I knew it was an option.

Re: The trust collapse: Infinite AI content is awful

#88

> Will you still be here in 12 months when I’ve integrated your tool into my workflow? This is the biggie; especially with B2B. It's really 3 months, these days. Many companies have the lifespan of a mayfly. AI isn't the new reason for this. It's been getting worse and worse, in the last few years, as people have been selling companies; not products, but AI will accelerate the race to the bottom. One of the things th…

> One of the things that AI has afforded, is that the lowest-tier, bottom-feeding scammer, can now look every bit as polished and professional as a Fortune 50 company (often, even more).

Made my day. So true.

Re: The trust collapse: Infinite AI content is awful

#89

Earlier quoted context omitted.

Turns out the Torment Nexus was just democratizing Venture Capital's desire for infinite growth.

The paperclip maximizer is us.

It's capitalism – the true "artificial intelligence" that has been organizing human life for the last ~200 years or so.

Re: The trust collapse: Infinite AI content is awful

#90
post #77

Earlier quoted context omitted.

Yeah. The modern software market actually seems like a total inversion of normal human bartering and trade relationships, actually… In Ye Olden Days, you go to the blacksmith, and buy some horseshoes. You expect the things to work, they are simple enough that you can do a cursory check and at least see if they are plausibly shaped, and then you put them on your horse and they either work or they don’t. Later you sell…

> In Ye Olden Days, you go to the blacksmith, and buy some horseshoes. You expect the things to work, they are simple enough that you can do a cursory check and at least see if they are plausibly shaped, and then you put them on your horse and they either work or they don’t Nit: that is not how it worked. You took your horse to the blacksmith and he (almost always he - blacksmiths benefit from testosterone even if we…

The annoying thing is, there was a voice in the back of my head saying “I’m pretty sure the blacksmith was more involved in the horse-shoeing process” as I wrote the post, but I’d already written enough of the post that I didn’t want to bother checking.

Well, no worries. If you subscribe to the post+ service I’ll fix it in a couple years, promise.

Post reply on HN