Earlier quoted context omitted.
I fear you will be unable to recognize when that burger was your choice and when it was a reaction. You probably won't notice. And that is harmless. I also fear you will be unable to notice in which areas of life and information the distinction between choice and reaction is harmless and which it isn't. Of course, I'm not talking about "You" you, but just people. Me as well. I feel we are widening the field of uncons…
> I feel we are widening the field of unconscious decisions and I see that as inherently bad I'm curious why you think this is bad. I don't necessarily think it is good but I also don't necessarily think it is actually happening
Which news-sources are you going to learn about?
Which news-sources are you for some reason very unlikely to encounter?
Now apply a real-time AI filter-bubble, able to also include government policies in its decision-making, onto those questions.
I believe the most important thing in life is thinking. I believe a key element of thinking is looking at "easy stuff", the stuff we just live with every day and don't think about, and for some reason be forced to think about it and make it simple.
Take the Snowden-leak. We lived a nice life being the good guys and that kind of surveillance was publicly thought of as conspiracy theories. Suddenly we were forced to look at what was going on. How much of it are we okay with? On the grounds of what principles and tradeoffs? This is all very unpleasant, but we're all better off for facing those questions and work towards new principles. We take a chaotic gruel of cons and pros, and try to hammer them into a few simple principles our societies may function by. For instance, the separation of power into 3 has served us well.
I fear that we end up in a world where raising such unpleasant questions becomes almost impossible - and we'll never even notice. Not because of AI (I believe AI to be inevitable and fascinating) but because of the way AI is used.
Living a life assisted by an AI, made and paid for by someone else, seems like the epitome of naivete to me.