I don't have a problem with AI and can't stand the anti-AI brigade, but... this is the worst thing I have ever seen in my life. This specific type of garbage is exactly what arms the anti-AI critics with valid arguments. We should really wait a few years for the technology to mature before releasing these kinds of projects into the cultural sphere.
If you benchmark is to be better than a human familiar with the task at hand, then you will be disappointed. If you are not expecting them to be as good as people then their failures seem wholly unremarkable. The specific nature of tbe failures can be quite interesting in fact. They can expose deficiencies in the architecrure, training data, or presumptiona of those controlling the models. In my experience very few p…
But I am bothered when they put a pencil in the mouth of a fish and tell us that this is the future of literature, that this qualifies as playwright, and that theaters will soon begin putting on plays written by a fish with a pencil in its mouth.