The particularly worrying thing here is that they're now going to be gathering training data for a conversational model on _how to influence people effectively even when they already know they are being influenced_. Even more than RLFH already does. "We had to build the Torment Nexus so our children could eat" is not a good reason to build the Torment Nexus. The fact that they are not committing to not doing this tel…
https://arstechnica.com/science/2025/12/researchers-find-wha...
Of course it is possible Google will create something orders of magnitude better but I doubt it. Amazon is already doing product recommendation on their front page and while it certainly drives sales it doesn’t turn people into zombies buying products they don’t want.
What did work really well was the “1 click buy” button. Reducing the friction for people who already want to buy is usually a much higher ROI than persuading people who previously weren’t interested.