So this AI has been trained on conversational data. It seems to have opinions and can express why it has them for general knowledge questions. Now, what happens when you dump in a bunch of detailed knowledge? Can you give it an advanced CS or EE degree, for example? Just dump in all the textbooks for training and then ask it to design the next version of itself to meet specific speed goals? Then I'll believe it's sen…
A good counter test here is to throw all the medical material at 100 people and ask them to design another human. How many people would manage that successfully?