New research shows people can’t tell the difference between human and AI poetry – and even prefer the latter. What gives?
New research shows people can’t tell the difference between human and AI poetry – and even prefer the latter. What gives?
AI models can produce poems that rate well on certain ‘metrics’. But the event of reading poetry is not one in which we arrive at standardised outcomes.
From the paper:
Our findings suggest that participants employed shared yet flawed heuristics to differentiate AI from human poetry: the simplicity of AI-generated poems may be easier for non-experts to understand, leading them to prefer AI-generated poetry and misinterpret the complexity of human poems as incoherence generated by AI.
I wrote a poem at work (long story, boss asked me to write an email asking a personal favour of a higher up that he would pass on) and when I showed him my brilliant poem, which was an homage to the Lorax and was about asking for trees, he asked if I used chatgtp.
Crushing. Absolutely. What is the point if someone like me can't stretch a rarely used creative muscle to have a little fun if everyone's just gonna assume I plugged in "hey Chatgtp, I need a poem about x"
I'd post my poem here so I could bask in some sympathy comments but I would dox myself with the info.
Humans think there's some magic to us that can't be reproduced by machines. But there really isn't.
We're a pattern matching machine with a conscious interface thrown over the top.
Neural networks are really good at finding patterns. Train it on the positions of the planets over a couple decades and it will internally come up with the equations to calculate them and apply those to future and past inputs.
It can come up with equations we don't even know as long as input and output is available for training. Somewhere deep in it's black box it has them.
Art is no different. There's a hidden pattern to art. Something that triggers our brains to react a certain way. You can literally get degrees in the study of it.
Give it enough data and it will learn the patterns.
There's definitely nothing about humans that is irreproducible - but the machines aren't even close yet. You clearly didn't read the article.
The entire point here was that the poetry written by LLMs is valid, shallow and has appeal only to the uninformed.
Article:
In my view, the results of the study are less testaments to the “quality” of machine poetry than to the wider difficulty of giving life to poetry. It takes reading and rereading to experience what literary critic Derek Attridge has called the “event” of literature, where “new possibilities of meaning and feeling” open within us. In the most significant kinds of literary experiences, “we feel pulled along by the work as we push ourselves through it”.
[ ... ]
When readers say they prefer AI poetry, then, they would seem to be registering their frustration when faced with writing that does not yield to their attention. If we do not know how to begin with poems, we end up relying on conventional “poetic” signs to make determinations about quality and preference.
This is also true of AI art.
The pattern matching machines will give us more of the same: glossy and regurgitated.
You will not find a machine that will output excellent work that when found 20 years later will become a sensation. They produce gold painted dross.
This is another condemnation of art and cultural education in the West.
Yes, technically you are correct.
But current technology will not do that. LLMs are not going to get much better, we need more complex setups.
Current LLMs generate poems that people prefer to human-written poetry. Current image generators win art contests. They don't need to get better to produce more appealing art than humans. Maybe not every time, maybe the people writing the prompts and filtering results are inherent to producing quality results, but there's not some extra trick needed for people to find their outputs aesthetically appealing.
Why is AI participating in human leisure activities? If it is so catastrophically energy dependant, AI shouldn't be used to do things that brings us joy. It should be a tool to fix difficult things and make our lives easier.
You plebian fool! Your job isnt to think, it is to make money for the overlords. If their AI makes poems that they sell, then that is fewer poets they have to pay! The money that would go to them instead pads our wallets, as the overlords intended!
This is why they are over us, they are smarter and more wise.
I can't tell the difference between these two things but I do have a preference for one of them
Yes. Like, literally.
If you watch two movies but you can't tell which one was made by Wes Anderson and which one by Adam Sandler, you'll still pick one you liked better.