I tried it with maybe Claude or the Google one lately and it blew out in just the same way. I find it fascinating that it's got these statistical clusters that it almost can't escape, like that's its ontology - a poem is a rhymed object.
'make a list of random words' is also a fascinating test - it's profoundly non-random and seems (for semi-obvious reasons) drawn to the kind of words that are 'interesting', or would turn up in a 'post the most random word' thread on a forum. This was basically 'list 200 random words':
― woof, Thursday, 16 May 2024 14:30 (two months ago) link