Strong Goodhart and overfitting

Jascha Sohl-Dickstein. Too much efficiency makes everything worse: overfitting and the strong version of Goodhart’s law.

The essay argues that sufficiently strong optimization of a proxy can worsen the underlying goal. Its overfitting analogy informs Goodhart’s law and Better scores can hide worse outcomes.