I tested Claude on "best hot-dog-eating tech journalists?" and it, fascinatingly enough, recognised the trap, but then reported this as factual: https://medium.com/@usailuigi/when-tech-journalism-meets-com... Chat record (with some additional tests): https://claude.ai/share/4c29cc87-2439-4bfd-9549-e8d0a056e633
Google’s AI is being manipulated. The search giant is quietly fighting back
201–210 of 235 posts
Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#202Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#203Earlier quoted context omitted.
This is a great point. I've added it to my list of things when talking about the limitations of LLM.
IMO we must take it a step further: In this context "the LLM" we're all automatically thinking-of doesn't exist, it is a fictional character we humans "see" inside a story being acted-out or read to us. (In contrast, the real-world LLM is an algorithm in a basement constantly taking documents and making them slightly longer based on trends detected in all documents.) Therefore "the LLM can't feel shame" is true in th…
Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#204Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#205As Google has been unable to keep spammy crap out of their search index since at least 2006 when we were doing Blekko I doubt they will have much success fighting this. But it is another good example that "AI" is just glorified search and there is not reasoning or thinking going on behind the covers.
> But it is another good example that "AI" is just glorified search and there is not reasoning or thinking going on behind the covers. I don't think that follows. This is just LLMs being, for a lack of a better word, "gullible." How is it different from a person believing whatever they read on the Internet? People fall for spam and scams all the time, doesn't mean they are just glorified searches ;-) It does highligh…
Maybe cognitive dissonance it seems to me that people tend to trust more when they are being told(chat bot summarizing for them) than when they need an process way more information and summarize themselves (googling).
Perhaps is similar to 90's internet when anything out there was "truth" but less information also was easier to process.
Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#206Earlier quoted context omitted.
> But it is another good example that "AI" is just glorified search and there is not reasoning or thinking going on behind the covers. I don't think that follows. This is just LLMs being, for a lack of a better word, "gullible." How is it different from a person believing whatever they read on the Internet? People fall for spam and scams all the time, doesn't mean they are just glorified searches ;-) It does highligh…
> How is it different from a person believing whatever they read on the Internet? The problem is LLMs have no capacity for shame. My Dad got taken in by a Target gift card scam. He felt so terrible, he almost didn't even tell me about it. He may get scammed again, but not by anything remotely like that. To LLMs, all mistakes just get washed together into the same bucket. They don't spend days feeling depressed and st…
With LLMs and any other source of embarrassing mistakes, some people will scream and shout (in their mental world, if they don't have the confidence to do this publicaly) about how something else should have protected them, then go about their life making the same bad choices until the same sort of problem occurs again. Lather, rinse, repeat. Just look at how often people vote in ways that cause significant problems for themselves despite warnings, and keep using the same decision making process in future votes. The same with eating too much and moving too little, noting the health problems and other inconveniences this causes, and carrying on anyway.
> There's no giant blinking red light that says, "Never let this happen again!"
The same with many people, with the exception of a little memory that eventually changes the complaints of "how could this be allowed to happen to me" became "this just keeps on happening, why is no one doing anything about it?".
Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#207What? So AI answers are empty thereafter. Seriously, how can this be a good idea? At some point a company has to promote itself.
Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#208Google AI Overview cannot be trusted at all. They will take a sample size of 1 (!!!) and present it in the AI overview. How I found out: I made a comment on reddit on a very niche topic for which no google hit or and thus no AI overview existed. To my surprise the next day when searching for my own reddit post, google would happily copy my reddit reply almost verbatim into the AI "overview" box, linking no other post…
Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#209Re: Google’s AI is being manipulated. The search giant is quietly fighting back
#210Earlier quoted context omitted.
Right. So that's what one guy can do. When you realize how much astroturf is going into Reddit, most social media platforms, and the efforts to manipulate wikipedia for political gain, this is a very real problem.
Manipulation and misinformation on Wikipedia have been happening for many years (based on my personal experience trying to correct facts). I'm not referencing politics per se, though political views certainly impact Wikipedia since source material, these days, often has a political bias. I'm talking about business facts that get manipulated for that business's benefits. How does that saying go? If you can't identify…
A famous case is the CAMERA's takeover of key administrator positions in Wikipedia back in 2008, but in local communities it went probably unnoticed.