Italian translation at settesei.it
It doesn’t take a statistician, or even a spreadsheet, to recognize that the 2019 Australian Open wasn’t Novak Djokovic’s most difficult path to a major title. We can debate whether the straight-set win over Rafael Nadal in the final was due to Djokovic’s utter dominance or a subpar performance from (a possibly still recovering) Rafa. But there’s more to a grand slam title than the final, and the only top-18 opponent Novak faced in the first six rounds was Kei Nishikori, who retired after 52 minutes.
On the traditional grand slam leaderboard, quality of competition doesn’t matter. Roger Federer has 20, Nadal has 17, and now Djokovic has 15. As I’ve written before, the race is closer than that, since Nadal’s and Djokovic’s opponents have, on average, been stronger than Federer’s. My metric for “adjusted slams” estimates the likelihood that a typical major titlist would defeat the specific seven opponents that a player faced, based on their surface-weighted Elo at the time of the match. (I’ve also used this approach for Masters titles.) The explanation is a mouthful, but the underlying idea is simple: Some majors represent greater achievements than others, both because some eras offer stiffer competition and because some draws are particularly daunting.
A slam title against an average level of competition is worth exactly 1. Tougher paths are worth more than 1, and easier draws are worth less. Here is the current leaderboard, with each player’s raw tally, average difficulty rating of their titles, and adjusted total:
Player Slams Avg Diff Adj Slams Roger Federer 20 0.88 17.7 Rafael Nadal 17 1.01 17.1 Novak Djokovic 15 1.11 16.6
(The numbers in this post do not all precisely agree with those I’ve published in the past, because I’ve improved the accuracy of my Elo-based rating system. All three of the players have seen their adjusted slam totals decrease, because the improved Elo algorithm eliminates some of the Elo “inflation” that overvalued recent achievements.)
These three guys have often had to go through each other, but Djokovic has had the toughest paths of all. The average difficulty of his first 12 majors was 1.2, higher than all but three of Rafa’s titles, one of Roger’s, and two of those won by Pete Sampras. Only recently has he been able to boost his total without quite so much of a challenge. His Australian Open title was worth 0.84 majors, only the fourth of his titles against a below-average set of opponents. It was, however, tougher than Wimbledon or the US Open last year, which were worth 0.77 and 0.65, respectively.
It’s unlikely, of course, that the current leaderboard–adjusted or otherwise–will be the final reckoning among these three men. But on the adjusted list, they will probably remain tightly packed. Because the rest of the pack has weakened, with Andy Murray and Stan Wawrinka no longer regular features of the second week, major titles aren’t what they used to be. Early in the decade, it wasn’t uncommon for a player to beat multiple members of the big four en route to a title and add at least 1.2 to his adjusted tally.
In 2018, slam difficulty was barely half of that recent peak level:
Year Avg Diff 2002 0.73 2003 0.65 2004 0.82 2005 0.95 2006 0.77 2007 0.93 2008 1.05 2009 1.00 2010 0.95 2011 1.19 2012 1.23 2013 1.22 2014 1.28 2015 1.12 2016 1.27 2017 0.91 2018 0.69
This could all change, especially if Djokovic wins a Roland Garros title by upsetting Nadal. (Nothing generates high competition-adjusted numbers like beating Nadal on clay.) But it’s more likely that these three men will have to keep incrementing their totals by 0.6s and 0.7s. While that could be enough to put Rafa or Novak on top by the end of the 2019, it won’t give anyone a commanding lead. It’s a good thing that there’s a lot more to the GOAT debate than slam totals, because slam totals–when properly adjusted for the difficulty of achieving them–make it awfully hard to pick a winner.