"Next-token predictor" is the wrong mental model for LLMs gmcgoldr.github.io ↗

Garrin McGoldrick: “next-token predictor” describes how an LLM outputs text, not what it learned. Pre-training rewards predicting the data. Reinforcement learning rewards whole answers that work, like a chess engine that learns to win rather than to copy grandmasters.