Live data from Hacker News

The trust collapse: Infinite AI content is awful

arnon.dk

61–70 of 218 posts

Re: The trust collapse: Infinite AI content is awful

#61
post #32

Earlier quoted context omitted.

that's exactly my point - yes you need to prove beyond a doubt that YOU are the right one to buy from, because it's so easy for 3 Stanford dropouts in a trenchcoat to make a seemingly successful business in just a few days of vibecoding.

> 3 stanford dropouts in a trenchcoat I'm using this

please do, i've been forcing it on people for a year now

Re: The trust collapse: Infinite AI content is awful

#62

What I get from the article is that, proving that a company will stick around for a while after you’ve subscribed is hard now, because anybody can AI generate the general vibe of the marketing department of a big established player. This seems like it’ll be devastating for companies whose business model requires signing new users up for ongoing subscriptions. Maybe it could lead to a resurgence of the business model…

We already got your money, what do we need to work for again?

I think the point is that nobody will give companies money unless the product already works. No more "but in a month this'll get a really cool update that'll add all these features". If you can't trust that a company will continue to exist, you have to be confident that what you're buying is acceptable in its current state.

Re: The trust collapse: Infinite AI content is awful

#63

Doesn't matter. We must keep building more and more technology no matter the cost. Have an idea for a business? Build it. Does your business make the lives of people worse? Doesn't matter, keep pushing. Could some new technology ruin the lives and relationships that people have? Doesn't matter, just build it. We always need more, need to do more. Every experiment is valid, every impulse must be followed. More complex…

Turns out the Torment Nexus was just democratizing Venture Capital's desire for infinite growth.

That's an uncharitable take. Those VCs care very deeply about society, that's why they're funding so much research into the Torment Singularity (and giving so many talks about it) and making sure that the Right People get the Torment Nexus first so "we" can decide how it gets used.

Re: The trust collapse: Infinite AI content is awful

#64
post #12

Yuval Noah Harari, Sapiens fame [0], has a great quote (paraphrasing): Interviewer: How will humans deal with the avalanche of fake information that AI could bring? YNH: The way humans have always dealt with fake information: by building institutions we trust to provide accurate information. This is not a new phenomenon btw. In democracies, this is often either the government (e.g. the Bureau of Labor Statistics) or…

The problem is that too many people just don't know how to weigh different probabilities of correctness against each other. The NYT is wrong 5% of the time - I'll believe this random person I just saw on TikTok because I've never heard of them ever being wrong; I've heard many stories about doctors being wrong - I'll listen to RFK; scientific models could be wrong, so I'll bet on climate change being not real etc.

5% wrong is an extremely charitable take on the NYT.

I once went to a school that had complementary subscriptions. The first time I sat down to read one there was an article excoriating President Bush about hurricane Katrina. The entire article was a glib expansion of an expert opinion who was just some history teacher who said that it was “worse than the battle of Antietam” for America. No expertise in climate. No expertise in disaster response. No discussion of facts. “Area man says Bush sucks!” would have been just as intellectually rigorous. I put the paper back on the shelf and have never looked at one since.

Don’t get emotionally attached to content farms.

Re: The trust collapse: Infinite AI content is awful

#65

Earlier quoted context omitted.

Turns out the Torment Nexus was just democratizing Venture Capital's desire for infinite growth.

The paperclip maximizer is us.

Unironically: we worry about the ASI control problem but can't even reign in our billionaires

Re: The trust collapse: Infinite AI content is awful

#67
post #14
post #9

AI-esque blog post about how infinite AI content is awful, from "a co-founder at Paid, which is the first and only monetization and billing system for AI Agents".

So I can't have opinions? Also, this is entirely hand-written ;)

I think this basically proves your point. There were things about it that made me think it may have been at least "AI-assisted", until I saw your "guaranteed bot-free" thing at the bottom. Anyone doing entirely hand-written things from now on are going to be facing a headwind of skepticism.

Re: The trust collapse: Infinite AI content is awful

#68
post #18

Earlier quoted context omitted.

build things """"people"""" want

People want dopamine hints, gamification, addictive distractions, and a culture of competitive perma-hustle. If they didn't, we wouldn't be having these problems. The problem isn't AI, it's how marketing has eaten everything. So everyone is always pitching, looking for a competitive advantage, "telling their story", and "building their brand." You can't "build trust" if your primary motivation is to sell stuff to you…

If they didn't, we wouldn't be having these problems.

That assumes people have the ability to choose not to do these things, and that they can't be manipulated or coerced into doing them against their will.

If you believe that advertising, especially data-driven personalised and targeted advertising, is essentially way of hacking someone's mind to do things it doesn't actually want to do, then it becomes fairly obvious that it's not entirely the individual's fault.

If adverts are 'Buy Acme widgets!' they're relatively easy to resist. When the advert is 'onion2k, as a man in his 40s who writes code and enjoys video games, maybe you spend too much time on HN, and you're a bit overweight, so you should buy Acme widgets!' it calls for people to be constantly vigilant, and that's too much to expect. When people get trapped by an advert that's been designed to push all their buttons, the reasonable position is that the advertiser should take some of the responsibility for that.

Re: The trust collapse: Infinite AI content is awful

#69

I needed to get some builder quotes for my home. It did not enter my mind to go online to search for any. I just reached out to my family for any trustworthy builders they've had, and struck up conversations with some of my fancier neighbors for any recommendations. (I came to the conclusion that all builders are cowboys, and I might as well just try doing some of this myself via youtube videos) Using the internet to…

When we needed some work done, we asked family and friends too, and ended up with a cowboy. When the work needed to be re-done, we looked up local reviews for contractors, and ended up with someone who was more expensive but also much more competent, and the work was done to a higher standard.

> ended up with someone who was more expensive but also much more competent, and the work was done to a higher standard.

How do you know that? Or is it just that your bias is coybows are bad and so you assume someone who dresses and acts better is better?

Now step back, I'm not asking you personally, but the general person. It is possible that you have the knowledge and skills to do the job and so you know how to inspect it to ensure it was done right. However the average person doesn't have those skills and so won't know the well dressed person who does a bad job that looks good from the poorly dressed person who does a good job but doesn't look as good.

Re: The trust collapse: Infinite AI content is awful

#70
We see business go through this cycle a lot. Some new “better cheaper” thing comes along. Everyone implements it to keep up with the Jones’s. Suddenly there’s no differentiation because everyone has it and everyone thinks it sucks. Suddenly going back to some reworked version of the old thing is the new black.

One such example was call centers. In the 2000s implementing a call center in India was all the rage on cost cutting. The customer experience was terrible and suddenly having a US-based call center (the thing companies just abandoned) was now a feature.

I think we’ll see similar things with AI. Everyone will get flooded with AI slop. Folks will get annoyed and suddenly interacting with a real human or a real human writing original content will be a “feature” that folks flock to.

Post reply on HN