Why is AI generated language so hard to understand?(arxiv.org)
238 points by canjobear 1 day ago | 195 comments
tl;dr: Researchers analyzed AI-generated text and found that nine frontier LLMs use features known to increase human processing difficulty—low-frequency n-grams, inanimate subjects with animate verbs, long syntactic dependencies, stacked nouns, and reduced object relatives—more than human writing or round-trip translation paraphrases. They hypothesize this stems from LLMs being optimized for information density (via math, code, and reasoning training) rather than communicative clarity, and demonstrate the effect by fine-tuning a model with a length penalty, which pushes its output further from human-like language.
HN Discussion:
  • ↑RLHF optimizes for superficial markers of good writing rather than actual usefulness
  • ↑LLMs exhibit specific grammatical quirks like intransitive use of transitive verbs
  • ↑Directly quoting and endorsing the paper's conclusions about length penalty effects
  • ~AI text lacks grounding in a human mental model or physical reality
  • ↑AI is optimized for information density over human readability, confirming article's hypothesis