AI;DR (AI; Didn't Read)

Two reasons:

1. I can't effectively engage in follow-up conversation with the "author." I can't do it with the human (principal) because they didn't write it and can't explain it--and, in fact, they may not even personally agree with all if it!

2. It shifts the cognitive burden from writer to reader. What makes writing hard, and valuable, is the effort put into translating one's raw, unfiltered thoughts into writing that is easy to comprehend, and the writer's own unique personality that is expressed in it. As ambient prose, AI-generated writing is often not only more difficult to read than human-drafted prose, but it also has this "sameness" quality that makes every "author" have the same personality.

Is that an ego issue? Doesn't seem like it to me.

No, no, no, no - the whole point of customer support is that I am having a problem that requires attention from a representative of the business I am dealing with. Businesses really don't like doing this; they call it a cost center to have to talk to their own customers, so they staff their call centers with increasingly useless script-readers designed specifically to shield the people with knowledge of the matter you're facing against customers like you. This is a great solution for dealing with technically illiterate people who don't do basic troubleshooting and terrible for literally anyone else who actually tries to be a good customer.

There has even been an advert extoling the behaviour (I forget which phone OS brand it was for, which is a shame as I might like to try avoid buying anything from them): "if a friend asks a question and your phone can answer directly, shouldn't it?", to which my gut reaction is "absolutely fucking not, it shouldn't". My more considered reaction is pretty much exactly the same.

For a start I'd consider it rude and if I found out it was happening reduce my fucking my communication with that person, or call instead if messaging (unless it seems they have a fake them taking calls, no doubt that'll be a thing sooner rather than later). And quite frankly I will reply when I'm good and ready, thankyouverymuch, instant automated reactions plays far too much into the "always available" thing that I don't care for even without AI.

I look forward to future news stories where people with such features turned on suffer PII exfoliation or other hacks when someone finds a prompt injection hole, or just uses the feature as designed because the user has been too open with what they have given it access to and who it should respond to (perhaps by inaction, because the defaults will likely be wide open for "convenience" until there is uproar).