Models trained to talk to themselves

Rohit’s theory for why coding-tuned models feel stilted in conversation: under long-horizon agentic training, almost all their conversational partners are themselves, making a human user the unusual case. His phrase for it: the opposite of RLHF.