Signatures

[Luckieman]

" For example, "From the tenth sentence on, every prime-numbered sentence will contain a prime number of words."

I suspect it'd be a bit more sophisticated than that. There's plenty of scope, for example, for doing cryptographic math on the numeric values of the strings of letters, and that would be undetectable except by the machine (but would be thwarted by altering the text significantly). The best test of all, however, would be the human one "is this text generic or individual?" as the chatbot is a homogeniser by definition because it produces the most likely sequence of words based on its training data. That would work provided the human generated texts to be compared with were not banal and generic themselves. Unfortunately, machine generated poetry comes out of bots trained on human generated poetry - worth a thought maybe?

The AI doesn't *always* choose the most probable next word (or rather, it does, but can be ordered to choose any word among the next ten most likely, for example).  This pseudo-randomness gives some of the more creative-looking (or just crashingly nonsensical) output.  What it's unable to do is choose the best word, though it may happen to do so.

Yes, that's one way the guardrails work (another way is banning of certain associations). But this can be sidestepped by iterative feedback of output (which narrows the statistical distribution of choices). If that's done in training, you eventually get model collapse, if during use, you eventually get garbage (they're really the same thing except model collapse is permanent).

My key point though was (although I hope put it discreetly) that if you train on poor quality texts, the best the LLM can emit will be no  better than those texts (probably worse). So maybe we human authors have some responsibility here?

" What it's unable to do is choose the best word, though it may happen to do so. "

A recent article by an 'AI' expert from Duke University pointed out that getting intelligible, let alone intelligent, text out of an LLM is down to pure luck.