Earlier quoted context omitted.
Google, ChatGPT, Gemini, Perplexity, etc are all retrieval services (with some rudimentary remixing capabilities thrown in, for the latter few). Some human has to actually have interesting insights and write them. Retrieval services help with distribution & discovery. The less we’re connected, the harder it is to find the right audience who value your (niche) insights. Of course attribution and linking is important.
AI so much much more than retrieval since it knows how to correctly apply exist concepts to previously unexplored areas. You can ask ChatGPT how one might implement and enforce laws in a world where magic exists. Or time travel. Or whatever. Because it knows laws and it knows common fiction tropes and can reason well enough to surmise how to apply them together.
I have just two recent examples where I thought it would be faster to use chatgpt instead of reading the manual.
1. How to asynchronously (e.g. asyncio) record from the microphone in python. Chatgpt gave me good which looked elegant, but didn't work. Well turns out pyaudio isn't compatible with asyncio.
2. Trying to install a docker of some server (I think it was wallabag?) with an SSO using openid. Again I got a elaborate docker compose file and instructions for the server configuration. After trying to implement it for a while I realised that those configuration options don't exist. Chatgpt just invented them.
My conclusion from these is that one really shouldn't ask AI question were one already knows the answer/correct way and you just want to have something create the boilerplate. I shudder and the thought that people are proposing to use AI for medical purposes without supervision by a professional.