Genuinely curious as to why ChatGPT could not so I asked it.
Note the final bullet point. I posit, that if it is possible, it will happen (regardless of ethics), because the risk of not doing it (when your adversary will) outweighs the risk of doing it.
"You say an instance of the GPT cannot experiment with new architectures, but could it if a) it was modified by the developers and b) it was given access to sufficient computational resources?"
Response: "In theory, if a GPT model were to be modified by developers to include capabilities for analyzing, designing, and testing new architectures, and if it were given access to sufficient computational resources, it could potentially experiment with new architectures. This would involve incorporating additional machine learning and deep learning algorithms and methods, such as reinforcement learning, evolutionary algorithms, or neural architecture search, which can be used to explore new model designs.
However, there are a few caveats to consider:
- Developing such a system would require significant expertise in AI research, as well as an understanding of the specific problems that need to be addressed.
- The GPT model is a complex system, and adding the ability to self-improve or create new architectures could make the model even more complex and challenging to manage.
- The computational resources required to develop, test, and implement new architectures are substantial, and optimizing resource allocation would be a critical concern.
- Ensuring the safety and ethical use of such a self-improving AI system would be an essential consideration, as it could potentially lead to unintended consequences or malicious use.
Although it is theoretically possible to create a GPT-like model with the ability to experiment with new architectures, it would require significant advancements in AI research, development, and ethical considerations.