True, and relevant (I live with a professional editor)... yet I immediately think of Ximm's Law: Every critique of AI assumes to some degree that contemporary implementations will not, or cannot, be improved upon. Lemma: any statement about AI which uses the word "never" to preclude some feature from future realization is false. Lemma: contemporary implementations have already improved; they're just unevenly distribu…
Maybe AGI is possible and we'll have software defined human intelligence that's completely autonomous but that's not coming in the next slightly better RL trained LLM and if existed likely wouldn't be under our control anyway