He Wants AI Benchmarking To Be a Science, Not a Dark Art (opens in a new tab)
Moritz Hardt discusses what benchmark scores tell us, where comparisons go wrong, and how evaluation might improve.
Why I recommend itA reminder to ask what a score measures before treating a leaderboard as a scientific conclusion.
Quanta Magazine