Stop Anthropomorphizing Intermediate Tokens as Reasoning/Thinking Traces (2025)(arxiv.org)
315 points by nunodonato 55 days ago | 267 comments
tl;dr: This ICML 2026 position paper argues that calling intermediate tokens generated by LLMs "reasoning" or "thinking traces" is a harmful anthropomorphization rather than a harmless metaphor. The authors contend these traces don't actually reflect human-like problem-solving steps and shouldn't be treated as interpretable windows into model cognition, warning that this framing misleads both users and researchers. They call on the community to abandon such language to avoid questionable research directions and misuse of these models.
HN Discussion:
  • ↓Anthropomorphization concern is overblown; researchers know it's just a metaphor and humans naturally anthropomorphize things
  • ↑Intermediate tokens are better understood mechanically as search/annealing/scratch space rather than reasoning
  • ↑Traces shouldn't be treated as interpretable windows; focus on reproducibility and treating them as black boxes
  • ↓LLM outputs increasingly resemble human thinking, so anthropomorphizing is natural given our ignorance about cognition
  • ↓Prescriptive terminology policing in academic titles is off-putting and unwarranted given practical results