Earlier quoted context omitted.
The difference is that AI is using pattern matching while humans use reasoning to come up with new things. That means AI is not capable of producing meaningful _new_ content like discovering new mathematical theorems, because AI does not understand maths, whereas humans can come up with something meaningful based on _understanding_ of the content they have learned from. This is why when you ask e.g. ChatGPT about som…
Complete nonsense. https://www.nature.com/articles/s41587-022-01618-2 Language models can generate novel functioning protein structures that adhere to a specified purpose. Structures that didn't exist before nevermind found in the dataset. The idea that there's some special distinction between the reasoning LLMs do and what Humans do is unfounded nonsense. A distinction you can't test for (this so called "true unders…
That's why these models like ChatGPT are trained on massive models, to hide the fact that the AI is actually very dumb pattern matching machine.
The only reason they found these "new" protein structures is because AI could match them to a pattern that it learned from the training data.
They even claim this:
> akin to generating grammatically and semantically correct natural language sentences on diverse topics
Just like ChatGPT can generate grammatically and semantically correct natural language, except if the topic is not something it was trained on it will output grammatically and semantically correct nonsense.
> ProGen can be further fine-tuned to curated sequences and tags
Which suggests there still needs to be a human that can reason to be able to curate the sequences, something AI can't and probably at this stage never be able to do.
This is something companies running these models won't openly admit, because that would confuse investors.