Simona Halep’s Grand Slam First Round Woes

Italian translation at settesei.it

In the first-ever match at the US Open’s new Louis Armstrong Stadium yesterday, No. 1 seed and reigning French Open champion Simona Halep lasted barely an hour, losing to the big-hitting Kaia Kanepi. Halep has held the top ranking for more than six months running, and only ten women have owned the top spot for more total weeks than she has. But Halep fans aren’t exactly the the target market for second-week tickets at the majors.

As Christopher Clarey pointed out on Twitter, yesterday’s loss was Halep’s 12th first-round exit in 34 tries. That isn’t quite as bad as it sounds: Seven of the losses came in her first 12 entries, before she entered the top 50, and since Wimbledon 2013, she’s a more respectable 17-5, with one of those losses to Maria Sharapova in New York last year. Still, it’s not the type of winning percentage you’d expect to see from someone of her caliber.

Just how bad is it? To give us some context, I compared her record in her first 34 majors to other grand slam winners, as well as everybody else whose career lasted long enough to enter at least 30 slam main draws. The deeper we dig, the worse it looks.

Simona vs slam winners

I found 32 major champions who played at least 30 slam first rounds*. Most of them played more than that, but to make sure we compare like to like, I’m focusing on each player’s first 34 majors. The list is topped by some of the usual suspects: Chris Evert, Monica Seles, and Serena Williams all went undefeated in their first 34 round-of-128 matches.

* I’ve excluded majors with fewer than 128 entrants, and my database might be missing first-round results from a few more events early in the Open era. Technically, I’m looking only at round-of-128 results.

The average grand slam champion went 29-5 in her first 34 major first rounds. Only four, including Halep, lost at least 12 of those matches: Angelique Kerber also went 22-12, while Flavia Pennetta and Samantha Stosur lost 13. Only two others lost more than seven first rounders: Marion Bartoli went 24-10 in her first 34 first-round efforts, and Iva Majoli ended up at 23-11.

Simona vs the pack

I found 199 players in Open era history who have contested at least 30 round-of-128 matches at majors. That’s a fairly elite crew–as we’ve seen, more than 15 percent of them are slam champions. It’s challenge enough to maintain a high enough ranking to enter nearly a decade’s worth of majors.

Thus, our remaining 167-player sample of non-champions is still better than average: Considering each of their first 34 majors, they won 57.4% of their opening round matches. That translates into a record of 20-14, only a couple of wins worse than how Halep has fared so far. 58 of the 167 women, about 35%, won at least 22 of their first 34. 45 of them, or 27%, outdid Simona and won at least 23.

Two explanations spring to mind for the discrepancy between Halep’s status at the top of the game and her mediocre career performance at the majors. First, players are taking longer to develop into stars. Simona’s 5-7 record in her first 12 first rounds isn’t indicative of her current level. Standouts of prior generations, like Serena and Seles, skipped that level of development entirely, springing onto the scene as instant contenders. Even Jelena Ostapenko, the almost-still-teenage winner of the 2017 French Open, was a modest 7-5 in her first dozen major first rounds. Sloane Stephens, who won 11 of her first 12 (including one against Halep), currently sits at a more modest 19-8.

The other reason is more prosaic: the parity at the top of the women’s game. Even as Simona racks up weeks as number one, she just isn’t as good as many previous top-ranked players. Her greatness stems from managing to stay at a reasonably high level more consistently than any of her peers. That means lots of of second-tier titles, impressive (overall) won-loss records, and on the flip side, some unfortunate losses on big stages. On a tour without a dominant presence, that’s good enough to make her, by a healthy margin, the best in the game. But “best” is more fragile than it used to be, even in the first round of the grand slams.

Gerald Melzer’s 28-Point Hold, and Other Interminable Deuce Games

Italian translation at settesei.it

Last week during the second round of US Open qualifying, Gerald Melzer battled through a 28-point service game–that’s eleven deuces–en route to defeating Kenny De Schepper. (Perhaps mentally exhausted, he lost the next day to Felix Auger-Aliassime.) Watching the scoreboard from a nearby court, I assumed it had malfunctioned and the match was long over.

Such marathon games are rare, but they aren’t unheard of. Yesterday, another qualifier, Lloyd Harris, needed ten deuces to hang on to one game against Gilles Simon in their first round match. Neither Melzer’s nor Harris’s tally are close to the record, which is likely still a 28-deuce game in a 1996 contest between Alberto Berasategui and Marcelo Filippini. That’s 62 points–one point more than the legendary 28-minute full match between Bernard Tomic and Jarkko Nieminen. The entire match. An even longer game, spanning 37 deuces and 80 points, took place at the non-tour-sanctioned Surrey Championships in 1975.

The odds on paper

On the ATP tour, the server wins about 63% of points. In the last year, Melzer has won roughly 64%, about the same as De Schepper’s opponents, so we’ll use the slightly higher number. With a server winning 64% of points, the odds of reaching deuce are 24.4%. After that, the chances of getting to another deuce are a bit less than half, or 46.1%. The odds of an at-least-two-deuce game are 24.4% times 46.1%, the odds of an at-least-three-deuce game are 24.4% times 46.1% times 46.1%, and so on. Melzer’s eleven-deuce game is 24.4% times (46.1% ^ 10), a little bit better than one in ten thousand. The match required 30 games, so the chances of a 28-point game (or longer) at some point–assuming the underlying numbers are the same for De Schepper’s service games–are roughly 30 times better, one in three hundred.

The Simon-Harris 26-pointer is even more likely. On the challenger tour, Harris has won nearly 65% of his service points, while Simon wins better than 40% of return points against tougher competition. Combining those numbers to account for competition is beyond the scope of this post, but let’s say Harris was expected to win 61% of his service points. (He ended up winning only half, though that overall rate is heavily influenced by the marathon game.) The odds of any individual Harris service game lasting 26 points, assuming a 61% serve win rate, is about one in three thousand.

One last example: The Berasategui-Filippini record-setter was primed for some long games, as neither player won very many serve points, and the Casablanca clay has never been speedy. But even with favorable circumstances, 28 deuces is nearly impossible. Using a service points won rate of 58% for Filippini (he won 59.6% that year, while Berasategui’s opponents won 57.7%, and I’ve rounded down a tiny bit for the surface), the odds of an individual game lasting at least 62 points are nearly one in one billion.

Delayed toilet breaks

Let’s see how well the odds predict the real-life frequency of marathon games. In my database of about 435,000 tour-level games back to 2012, 42 games reached the 28-point mark, a rate of approximately one per ten thousand–the same as the theoretical number we saw for Melzer-De Schepper. Many of the games terminated after 28 points, and none went longer than 36 points. The most recent 36-pointer was in this year’s Australian Open third round, when Kyle Edmund broke Nikoloz Basilashvili’s serve (and his spirit) to take a 2-0 lead in the fourth set.

28-pointers–and long games in general–are a bit more common on the challenger tour. I found 81 in about 600,000 games–about one per 7,500 games–including three 38-pointers. Edmund figured in one of those prolonged games, barely failing to break Grega Zemlja’s serve at the 2016 Dallas Challenger. Melzer appears in the list as well, having fought through 28 points to hold against Robin Haase in the 2015 Trnava Challenger, though he ended up losing the match.

Theory and practice also match when we look at WTA data. Using a tour-average rate of service points won of 58%, we would expect to see a 28-pointer once every 4,600 games or so. In 367,000 recorded games, I found 89 instances, or one per 4,100. The record here outstrips anything in the last few years of ATP or Challenger data: Mathilde Johansson broke Elena Vesnina on the 40th point, after 17 deuces. She consolidated the break to win the second set, but dropped the decider.

Based on the last several years of data, Berasategui’s and Filippini’s record appears to be safe. Given the efforts to speed up the game, in which tennis executives would prefer no-ad to Berasategui’s brand of 28-ad, that’s probably for the best.

The Victims of Tiebreak Pressure

The conventional wisdom is that tiebreaks are all about two things: serves and mental strength. Despite my previous efforts, pundits continue to promote the idea that big servers have an edge in the first-to-seven shootout. Less contestably, experts remind us that a lot is at stake in a tiebreak, and the player who can withstand the pressure will prevail.

Back in 2012, I wrote a few articles about tiebreaks, using a year’s worth of data from men’s matches at grand slams to discover that servers hold less of an advantage during shootouts. On average, more points go the direction of the returner. I also found that very few players exceeded expectations in tiebreaks–that is, a player’s performance in non-tiebreak situations did a very good job of predicting his chances of winning tiebreaks. Last, I determined that big servers were not any more likely than their weaker-serving peers to be among the small group of players who boasted stronger-than-expected results in shootouts.

I’ve dug into a much larger dataset to revisit the first of these conclusions. My collection of sequential point-by-point data allows us to look at over 15,000 tiebreaks from the ATP tour alone, compared to fewer than 400 that I used in my earlier study. The broader and deeper sample will allow us go beyond general statements about serve or return advantages and look at how particular players fare in the jeu décisif.

Serving under pressure

First, the basics. In these 15,000 tour-level breakers, servers won 3.4% fewer points than they did in non-tiebreak situations. This is an apples-to-apples comparison: For each player in each match, I used his rate of service points won (SPW) on non-tiebreak points and his SPW on tiebreak points. To get the aggregate figure, I calculated the average of all player-matches, weighted by the number of tiebreaks in the match.*

* Initially, I weighted by the number of tiebreak points, thinking that, say, a 16-point tiebreak should be weighted more than an 8-point breaker. That gave me results that pointed to a huge improvement in SPW in tiebreaks … because of selection bias. When a tiebreak goes beyond 12 points, it often means that both players are serving well. Thus, when two servers are hot, they must play more points, increasing their weight in this calculation. It’s always possible that an extra-long tiebreak results from a lot of return points won, but in the serve-leaning men’s game, it is the much less likely scenario.

The 3.4% decrease in serve points won means that, for instance, a server who wins 65% on his own deal in the twelve games before the tiebreak will fall to 62.8% in the breaker. Fortunately for him, his opponent probably suffers the same drop. Benefits only accrue to those players who either maintain or increase their SPW after the twelfth game of the set.

It makes sense that servers suffer a bit under the pressure. In the men’s game, at least, the returner has little to lose. Since tiebreaks are thought to be serve-dominated, every return point won seems like a lucky break. Perhaps if players knew the real numbers, the mental game would shift back in their favor. They wouldn’t have to focus on becoming superhuman, unbreakable servers; they would need only to maintain the level that got them into the tiebreak in the first place.

The less-breakables

When we split things up by player, the dataset conveniently spits out 50 players with at least 100 tiebreaks. (Well, 49, but Nicolas Mahut was next on the list, so we’ll include him also.) The guys who play the most tiebreaks are either good, lucky, or both, because they’ve managed to stick around and play so many tour matches, so the average player on this list is a little better than the average player in general.

Here are the top and bottom ten in our group of the 50 most prolific tiebreak players. The first stat, “SPW Ratio,” is the ratio between tiebreak SPW and non-tiebreak SPW, so a higher number means that the player wins more serve points in tiebreaks than otherwise. Because that stat awkwardly centers on 0.966 (the 3.4% decrease), I’ve shown another stat, called here “Ratio+,” with all numbers normalized so the average is 1.0. Again, a higher number means more serve points won in tiebreaks. The 1.09 held by John Isner at the top of the list means that the big man wins 9% more breakers than expected, where “expected” is defined as the tour-average 3.4% drop.

Player               TBs  SPW Ratio  Ratio+  
Andy Murray          141       1.05    1.09  
John Isner           368       1.05    1.09  
Nick Kyrgios         109       1.05    1.08  
David Ferrer         132       1.01    1.05  
Alexandr Dolgopolov  116       1.01    1.05  
Lukas Rosol          100       1.01    1.05  
Jo-Wilfried Tsonga   188       1.01    1.04  
Roger Federer        175       1.01    1.04  
Nicolas Mahut         94       1.01    1.04  
Benoit Paire         139       1.00    1.04  
…                                            
Denis Istomin        120       0.94    0.98  
Viktor Troicki       104       0.94    0.97  
Tomas Berdych        181       0.93    0.96  
Nicolas Almagro      118       0.93    0.96  
Fernando Verdasco    156       0.93    0.96  
Robin Haase          123       0.93    0.96  
Adrian Mannarino     101       0.91    0.95  
Jiri Vesely          105       0.90    0.93  
Ryan Harrison        100       0.89    0.92  
Pablo Cuevas         100       0.87    0.90

Most of the big names who aren’t shown above (Rafael Nadal, Novak Djokovic, Juan Martin del Potro, Milos Raonic) are a bit better than average, with a Ratio+ stat around 1.02. I’m not surprised to see Isner or Roger Federer near the top, as those two have traditionally won more tiebreaks than expected. Less predictable is the chart-topping Andy Murray, who apparently manages to raise his serve game in breakers as well as anyone else.

Warning: Negative result ahead

Murray, Isner, and Federer have consistently served well in tiebreaks over the last seven years, the time span of this dataset. But even they have had seasons where they just barely edged out the tour average: Murray was 9% better than his peers in 2013 and 10% better in 2016, serving better in tiebreaks than non-tiebreaks by a 5% and 6% margin, resepectively, but in between, he was merely average. Isner, who was at least 10% better than tour average in each season from 2012 to 2015, served slightly worse in tiebreaks than in non-tiebreaks in 2016, and is just barely better than average in his first fifty shootouts of 2018.

These are small margins, and most players do not sustain positive or negative trends from year to year. To take another example, from 2014 to 2017, Raonic recorded single-season Ratio+ numbers of 1.11, 0.92, 1.00, and 0.98. I wouldn’t recommend putting any money on Milos’s full-season 2018 figure, let alone his tiebreak serve success in 2019.

Despite the evocative appearance of Isner, Federer, and Murray at the top of the list and some players considered to be mentally weaker near the bottom, there is no evidence that this is a skill, something that players will predictably repeat, rather than luck. As I did in my match point study earlier this week, I divided each player’s tiebreaks randomly into two groups. If tiebreak serve prowess were a skill, a player’s SPW Ratio in one random group would be reasonably predictive of his corresponding number in the other group. It is not to be: No matter where we set the minimum number of tiebreaks for inclusion, there is no correlation between the two groups.

If you’ve gone through many of my posts, you’ve read something like this before. Handling the pressure and serving well in tiebreaks seems like something that certain players will do well and others will not. This overall finding isn’t sufficient proof to say that no players have tendencies in either direction–most tour pros simply don’t contest enough tiebreaks over their entire careers to know that for sure. But with possible exceptions like Isner, Murray, Federer, and the unfortunate Pablo Cuevas, players converge around the tour average, which means their service game becomes a little less effective in breakers. If someone posts a particularly high or low SPW Ratio for a season, it probably means luck figured heavily in their results. If you’re going to bet on something using these numbers, the smart money suggests that most players will revert to the mean.

What Cincinnati Taught Us About the Serve Clock

Italian translation at settesei.it

So far, the serve clock has not made matches faster. In my article for The Economist earlier this week, I showed that in the handful of tournaments played with the new technology thus far, players took longer to play each point than they did at the same events last year.

That article included data from San Jose, Washington, Toronto, and Montreal. Last week, the combined Masters/Premier event in Cincinnati gave us another several dozen matches, with a slightly different mix of players, to further test how the serve clock is affecting the speed of play. Given another week of experience with the visible timers, the pace of play remains slower than it was one year ago.

In the Cincinnati men’s event, players used 41.2 seconds per point this year, compared to 39.8 seconds per point last year. In the women’s draw, it was 40.8 seconds per point this year, up from 40.2 seconds per point last year. Both increases are roughly the average change that we saw in the tournaments of the two previous weeks. Here is a breakdown of the time per point at each event, where “S/P” means seconds per point. Also shown are tour and overall averages, weighted by the number of matches at each event:

M/W      Tournament  2017 S/P  2018 S/P  Change  
Men      Cincinnati      39.8      41.2    +1.4  
Men      Canada          40.2      41.4    +1.2  
Men      Washington      40.3      42.2    +1.9 
 
Women    Cincinnati      40.2      40.8    +0.6  
Women    Canada          40.7      41.8    +1.1  
Women    Washington      40.2      41.6    +1.4  
Women    San Jose        40.3      40.7    +0.4  
                                                 
Men      Average         40.1      41.6    +1.5  
Women    Average         40.4      41.2    +0.8  
Overall  Average         40.2      41.4    +1.2

* alert readers might notice small discrepancies between these figures and those cited in the Economist, which are due to rounding errors.

Several readers have commented on the imprecision of this measurement. (I did too, in the original post.) Short of taking a stopwatch to every single match, there’s no way of auditing umpires by collecting the exact length of time between each pair of points. The exact mix of players in any given draw can affect the overall measurements–I experimented with a simple model to control for players, but it presented more problems than it solved. I agree, this is far from the final word on the serve clock, even apart from the fact that the way that umpires use it will probably evolve.

Still, these numbers point in only one direction. A similar survey of unaffected tournaments confirms that 2018 is not slower in general: For instance, of the men’s and women’s draws in Indian Wells, Miami, and Madrid this year, four of the six brackets decreased in average time per point, and one of the others increased by only 0.1 seconds per point.

Also, it’s important to remember that one presumed goal of the clock is to speed up play, not simply keep it steady. If time per point were staying roughly the same as last year, that itself would indicate that the new technology isn’t living up to its billing. That seven out of seven events have all gotten slower allows us to make an even stronger claim.

Fortunately for the tours, there is plenty of room for the use of the clock to evolve. The most glaring example is the umpiring practice of waiting until crowd noise dies down to start the clock. Yes, players can’t be expected to serve in a noisy stadium, but the cheering usually stops after ten seconds or so. Rather than add that ten seconds to the time allotment between points, umpires should start the clock immediately and then, on the rare occasions when the crowd remains disruptive, pause as necessary.

Its unlikely that matches will still be slower when the serve-clock dust has settled. But the goalposts have moved: At this stage of the process, it would be progress if matches with visible timers were simply the same speed as the ones that came before.

Simona Halep’s Match Points

Italian translation at settesei.it

In the second-set tiebreak of Sunday’s Cincinnati final, Simona Halep reached match point against Kiki Bertens. She failed to convert, then Bertens claimed the tiebreak, and the third set–and the championship–went the way of the Dutchwoman. It was a bit of painful deja vu for Halep fans, who watched the top-ranked player reach match point against Su Wei Hsieh at Wimbledon only to miss her chance and crash out in the third round.

Halep has a reputation as a bit of a weak closer–not just match points, but set points and, more generally, service games with the set or match on the line. Her overall ability to finish matches is beyond the scope of a single post, but we can start by biting off the smaller chunk of, specifically, her performance on match points, and how that compares to the rest of the WTA.

Let’s start with the basics. For everyone, reaching match point is (obviously!) a really good sign that she’ll go on to win the match. Across about 16,000 WTA matches since 2011 for which I have sequential point-by-point data, players who hold match point end up winning the match a bit more than 97% of the time. That doesn’t mean that they convert on the first try, or even in the game or set of their first opportunity, but even when conversion is elusive, players manage to generate more chances until they finish the job.

If Simona really is a weak closer, we’ll need to look elsewhere for evidence. In the matches for which I possess the point-by-point sequence*, there are 251 contests in which Halep held a match point, stretching between the end of 2011 and this month’s Rogers Cup in Montreal. Of those, she eventually converted a match point 250 times. That is, with the exception of the Wimbledon match against Hsieh, she didn’t lose any matches in which she was a point away from victory.

* I don’t have the point-by-point sequence for every Halep match, but I have most of them, and the missing ones are random. The same applies to just about every WTA player. Some of the raw data is available here; I’m hoping to update with 2017 and 2018 data in the near future.

Compared to the best players, this level of MP conversion doesn’t even stand out. Among the 50 women with at least 100 matches in which they held match point, five–Serena Williams, Victoria Azarenka, Andrea Petkovic, Ekaterina Makarova, and Elena Vesninaalways converted, if not always on the first try. (Again, I’m missing some matches, but that doesn’t take away from the fact that in a random sample of 259 matches, Serena remains perfect.) Until Sunday’s Cincinnati final, Halep was one of eight more–with Petra Kvitova, Maria Sharapova, and Ana Ivanovic, among others–who failed to convert only once.

Situational performance

It’s no accident that the most dominating names in tennis are near the top of that list. Yes, the best players are most likely to win at match point, but just as important, the best players are more likely to earn several opportunities. Deep in a tiebreak, one missed chance can represent the final hope, but most of the time when Halep, Serena, or someone else of their ilk fails to convert an opportunity, they’re still leading by, say, a set and a break, making it easy to generate more chances.

That leads us to another question: How do players perform on match point itself? Does the pressure lead to fewer points won, compared to non-MP serve and return points? Or do other factors, like momentum or crowd support, cause players to do even better when one point away from victory?

It turns out that there’s no single answer; the results are a bit different depending on whether the player holding match point is serving or returning. When a player is serving to finish off a match, she is slightly less likely to win the point, compared to her serve performance up to that point. It’s not a big difference–a bit less than a 3% drop in the rate of serve points won–but it is persistent across several years of WTA results. When players are one point away from victory but are returning, there is no match-point effect. They win return points at the same rate regardless of whether a handshake is imminent.

Match points are almost evenly distributed between serve and return points–on the WTA tour, about 55% are serve points, leaving 45% return points. Thus, given the 3% drop on serve performance and the lack of change on return points, players win approximately 1.5% fewer points when one step away from victory than otherwise. One player who almost exactly parallels the average is Caroline Wozniacki–in 271 match-point matches and 474 match points, she won those MPs at a rate 1.7% lower than non-MPs.

Some of the players who almost always win their match-point matches aren’t any better than average when we look at individual points. For instance, Sharapova wins MPs a rate 1.2% lower than non-MPs, and Azarenka’s success rate drops by 1.4%. Dominika Cibulkova won 198 of the 201 match-point matches in my dataset despite her success rate falling by a whopping seven percent.

Halep, however, doesn’t fit in that category. In her 251 match-point matches, she has held 420 individual match points, which she has won at a rate 4.4% higher than her non-MP rates in the same set of matches. Few players are better, though a handful are overwhelmingly so, such as Kvitova at +9.0%, and Vesnina at +13.9%. The vast majority of women are within a few percentage points of neutral: They win match points, whether serve or return, about as often as they win non-match-points.

Random results

These numbers tell us only one thing: what has happened in the past. It is tempting to use them to make predictions, or perhaps lay down a sizable wager the next time Vesnina is a point away from victory. But when most players are so close to neutral, it’s a warning that much of what we’re looking at may be random.

If players have consistent tendencies in match point situations, we would be able to identify that in the data. For instance, we might see that Kvitova converts match points at a high rate in each individual season. Since the single-season totals make for sometimes small samples, I took a slightly different approach. For players with at least 60 match-point matches, I randomly divided their matches into two separate groups, and determined how their performance at MP compared to their success rate on other points. Again, if this were a real skill, we would expect that players would be roughly the same in each of their two random groups–better than usual on MP in both groups, or worse.

Alas, for this population of 80 players with sufficient match-point samples, there is no correlation at all. If women have consistent, predictable tendencies to outperform or underperform in match-point opportunities, these inclinations are either extremely small, or they don’t persist over several years.

This is a familiar refrain when looking at specific situations in tennis matches. Our hyperactive, pattern-seeking brains find it easy to identify apparent tendencies, but in general, players win points at about the same rate regardless of the context. Over the medium term, like the half-decade represented by my point-by-point dataset, some players will stick out, like Kvitova, Vesnina, and to a lesser extent, Halep. But past results are hardly a guarantee of future match-point performance. The smart prediction for any player’s upcoming results on match point is that she’ll do exactly as well as she does the rest of the time. It’s a rather boring conclusion. Thankfully, the match points situations themselves are usually exciting enough on their own.

Economist: The new serve clock in tennis appears to be backfiring

At the Economist Game Theory blog, I wrote about the early effects of the new serve clock. The outwardly stricter time policy didn’t speed up Rafael Nadal, nor did it cut down match times in general over its first two weeks:

The Toronto champion wasn’t the only player who slowed down once on the clock. At each of the completed tournaments where the serve clock has been used—Toronto, Montreal, San Jose, and Washington, D.C.—the average point took longer in 2018 than it did in 2017, without the clock. The differences varied from 0.3 seconds per point at the women’s event San Jose (an event that was held in nearby Stanford last year) to 2.0 seconds at the men’s competition in Washington.

Read the whole thing.

Podcast Episode 29: A New Davis Cup and a Career Golden Masters

In Episode 29 of the Tennis Abstract Podcast, with Carl Bialik of the Thirty Love podcast, we spend so much time talking about the Davis Cup reforms, if ITF head David Haggerty were to listen, he’d immediately try to change our format to something shorter. While we recorded the episode before yesterday’s finals in Cincinnati, we also touch on several other topics: the impressiveness of Novak Djokovic’s career record at all the Masters, the players who–like Sloane Stephens–have powerful groundstrokes that they save for special occasions, and Simona Halep’s aggressive scheduling.

Thanks for listening!

(Note: this week’s episode is about 66 minutes long; in some browsers the audio player may display a different length. Sorry about that!)

Click to listen, subscribe on iTunes, or use our feed to get updates on your favorite podcast software.

Update: Episode index with links, thanks to FBITennis:

Davis Cup Reforms Generally 1:49
Team and mixed gender tennis trend 6:15
Effect of DC reforms on smaller tennis federations 8:11
Will big stars play more often in the new DC format? 12:17
Davis Cup analogy to World Baseball Classic 18:39
Which countries benefit most from the new DC format? 22:09
Cincinnati F (men’s):  Djokovic v Federer 26:05
US Open favorites (men’s) 29:45
How close is Stan Wawrinka in getting back to form? 33:12
Variation in ground stroke speed (e.g., Wawrinka, Stephens) 37:10
Simona Halep’s crazy schedule 47:05
Discussion of New Haven event 50:26
US Open qualifying matches (how to choose?) 57:00

Measuring a Season’s Worth of Luck

In Toronto last week, Stefanos Tsitsipas was either very clutch, very lucky, or both. Against Alexander Zverev in Friday’s quarter-final, he won fewer than half of all points, claiming only 56.7% of his service points, compared to Zverev’s 61.2%. The next day, beating Kevin Anderson in the semi-final in a third-set tiebreak, he again failed to win half of total points, holding 69.9% of his service points against Anderson’s 75.5%.

Whether the Greek prospect played his best on the big points or benefited from a hefty dose of fortune, this isn’t sustainable. Running those serve- and return-points-won (SPW and RPW) numbers through my win probability model, we find that–if you take luck and clutch performance out of the mix–Tsitsipas had a 27.8% chance of beating Zverev and a 26.5% chance of beating Anderson. These two contests–perhaps the two days that have defined the youngster’s career up to this point–are the very definition of “lottery matches.” They could’ve gone either way, and over a long enough period of time, they’ll probably even out.

Or will they? Are some players more likely to come out on top in these tight matches? Are they consistently–dare I say it–clutch? Using this relatively simple approach of converting single-match SPW and RPW rates into win probabilities, we can determine which players are winning more or less often than they “should,” and whether it’s a skill that some players consistently display.

Odds in the lottery

Let’s start with some examples. When one player wins more than 55% of points, he is virtually guaranteed to win the match. Even at 53%, his chances are extremely good. Still, a lot of matches–particularly best-of-threes on fast surfaces–end up in the range between 50% and 53%, and that’s what most interesting from this perspective.

Here are Tsitsipas’s last 16 matches, along with his SPW and RPW rates and the implied win probability for each:

Tournament  Round  Result  Opponent     SPW    RPW  WinProb  
Toronto     F      L       Nadal      62.9%  21.1%       3%  
Toronto     SF     W       Anderson   69.9%  24.5%      27%  
Toronto     QF     W       A Zverev   56.7%  38.8%      28%  
Toronto     R16    W       Djokovic   77.2%  32.0%      85%  
Toronto     R32    W       Thiem      83.3%  30.2%      93%  
Toronto     R64    W       Dzumhur    82.8%  35.0%      98%  
Washington  SF     L       A Zverev   54.7%  25.5%       1%  
Washington  QF     W       Goffin     71.2%  32.7%      67%  
Washington  R16    W       Duckworth  80.0%  37.5%      98%  
Washington  R32    W       Donaldson  59.5%  45.5%      74%  
Wimbledon   R16    L       Isner      72.5%  18.0%      10%  
Wimbledon   R32    W       Fabbiano   64.0%  55.9%     100%  
Wimbledon   R64    W       Donaldson  70.1%  40.9%      95%  
Wimbledon   R128   W       Barrere    71.5%  39.0%      94%  
Halle       R16    L       Kudla      59.7%  28.8%       8%  
Halle       R32    W       Pouille    78.3%  42.9%      99%

More than half of the matches are at least 90% or no more than 10%. But that leaves plenty of room for luck in the remaining matches. Thanks in large part to his last two victories, the win probability numbers add up to only 9.8 wins, compared to his actual record of 12-4. All four losses were rather one-sided, but in addition to the Toronto matches against Zverev and Anderson, his wins against David Goffin in Washington and, to a lesser extent, Novak Djokovic in Toronto, were far from sure things.

In the last two months, Stefanos has indeed been quite clutch, or quite lucky.

Season-wide views

When we expand our perspective to the entire 2018 season, however, the story changes a bit. In 48 tour-level matches through last week’s play (excluding retirements), Tsitsipas has gone 29-19. The same win probability algorithm indicates that he “should” have won 27.4 matches–a difference of 1.6 matches, or about five percent, which is less than the gap we saw in his last 16. In other words, for the first two-thirds of the season, his results were either unlucky or un-clutch, if only slightly. At the very least, the aggregate season numbers are less dramatic than his recent four-event run.

For two-thirds of a season, a five percent gap between actual wins and win-probability “expected” wins isn’t that big. For players with at least 30 completed tour-level matches this season, the magnitude of the clutch/luck effect extends from a 20% bonus (for Pierre Hugues Herbert) to a 20% penalty (for Sam Querrey, which he reduced a bit by beating John Isner in Cincinnati on Monday despite winning less than 49% of total points). Here are the ten extremes at each end, of the 59 ATPers who have reached the threshold so far in 2018:

Player                 Matches  Wins  Exp Wins  Ratio  
Pierre Hugues Herbert       30    16      13.2   1.22  
Nikoloz Basilashvili        34    17      14.0   1.21  
Frances Tiafoe              39    24      20.0   1.20  
Evgeny Donskoy              30    13      10.9   1.19  
Grigor Dimitrov             34    20      17.1   1.17  
Lucas Pouille               31    16      13.7   1.17  
Gael Monfils                34    21      18.3   1.15  
Daniil Medvedev             34    18      15.8   1.14  
Marco Cecchinato            33    19      16.7   1.14  
Maximilian Marterer         32    17      15.2   1.12  
…                                                      
Leonardo Mayer              37    19      20.1   0.95  
Guido Pella                 37    20      21.2   0.95  
Marin Cilic                 38    27      28.8   0.94  
Novak Djokovic              37    27      29.3   0.92  
Marton Fucsovics            30    16      17.5   0.92  
Joao Sousa                  36    18      19.8   0.91  
Dusan Lajovic               34    17      18.7   0.91  
Fernando Verdasco           43    22      24.5   0.90  
Mischa Zverev               39    18      20.7   0.87  
Sam Querrey                 30    15      18.8   0.80

A difference of three or four wins, as many of these players display between their actual and expected win totals, is more than enough to affect their standing in the rankings. The degree to which it matters depends enormously on which matches they win or lose, as Tsitsipas’s semi-final defeat of Anderson has a much greater impact on his point total than, say, Querrey’s narrow victory over Isner does for his. But in general, the guys at the top of this list are ones who have seen unexpected ranking boosts this season, while some of the guys at the bottom have gone the other way.

The last full season

Let’s take a look at an entire season’s worth of results. Last year, a few players–minimum 40 completed tour-level matches–managed at least a 20% luck/clutch bonus, but with the surprising exception of Daniil Medvedev, none of them have repeated the feat so far in 2018:

Player                 Matches  Wins  Exp Wins  Ratio  
Donald Young                43    21      16.2   1.30  
Fabio Fognini               58    35      28.5   1.23  
Jack Sock                   55    36      29.8   1.21  
Jiri Vesely                 45    22      19.3   1.14  
Daniil Medvedev             43    22      19.7   1.11  
John Isner                  57    36      32.3   1.11  
Damir Dzumhur               56    33      29.7   1.11  
Gilles Muller               48    30      27.1   1.11  
Alexander Zverev            74    53      48.1   1.10  
Juan Martin del Potro       53    37      33.6   1.10

A few of these players have had solid seasons, but posting a good luck/clutch number in 2017 is hardly a guaranteed, as the likes of Donald Young, Jack Sock, and Jiri Vesely can attest. Here is the same list, with 2018 luck/clutch ratios shown alongside last year’s figures:

Player                 2017 Ratio  2018 Ratio     
Donald Young                 1.30        0.89  *  
Fabio Fognini                1.23         1.1     
Jack Sock                    1.21        0.68  *  
Jiri Vesely                  1.14        1.08  *  
Daniil Medvedev              1.11        1.14     
John Isner                   1.11        0.96     
Damir Dzumhur                1.11        1.01     
Gilles Muller                1.11        0.84  *  
Alexander Zverev             1.10        1.06     
Juan Martin del Potro        1.10        1.07

* fewer than 30 completed tour-level matches

The average luck/clutch ratio of these ten players has fallen to a bit below 1.0.

Unsustainable luck

You can probably see where this is going. I generated full-season numbers for each year from 2008 to 2017, and identified those players who appeared in the lists for adjacent pairs of seasons. If luck/clutch ratio is a skill–that is, if it’s more clutch than luck–guys who post good numbers will tend to do so the following year, and those who post lower numbers will be more likely to remain low.

Across 325 pairs of player-seasons, that’s not what happened. There is almost no relationship between one year of luck/clutch ratio and the next. The r^2 value–a measure of correlation–is 0.07, meaning that the year-to-year numbers are close to random.

Across sports, analysts have found plenty of similar results, and they are often quick to pronounce that “clutch doesn’t exist,” which leads to predictable rejoinders from the laity that “of course it does,” and so on. It’s boring, and I’m not particularly interested in that debate. What this specific finding shows is:

This type of luck, defined as winning more matches than implied by a player’s SPW and RPW in each match, is not sustainable.

What Tsitsipas accomplished last weekend in Toronto was “clutch” by almost any definition. What this finding demonstrates is that a few such performances–or even a season’s worth of them–doesn’t make it any more likely that he’ll do the same next year. Or, another possibility is that the players who stick at the top level of professional tennis are all clutch in this sense, so while Tsitsipas might be quite mentally strong in key moments, he’ll often run up against players who have similar mental skills, and he won’t be able to consistently win these close matches.

If Stefanos is able to maintain a ranking in the top 20, which seems plausible, he’ll probably need to win more serve and return points than he has so far. Fortunately for him, he’s still almost eight years younger than his typical peer, so he has plenty of time to improve. The occasional lottery matches that tilt his way will need to be mere bonuses, not the linchpin of his strategy to reach the top.

Podcast Episode 28: Tsitsipas, Sloane, and the Serve Clock

Episode 28 of the Tennis Abstract Podcast, with Carl Bialik of the Thirty Love podcast, is our triumphant (re-) return to podcasting. We cover all the highlights from last week’s Rogers Cup, especially the breakout week from Stefanos Tsitsipas, the strong showing from Sloane Stephens, and the quiet dominance of Rafael Nadal and Simona Halep.

We also cover tennis’s new serve clock, which has entered the game surprisingly smoothly … but without much effect on the pace of play. Thanks for listening!

(Note: this week’s episode is about 63 minutes long; in some browsers the audio player may display a different length. Sorry about that!)

Click to listen, subscribe on iTunes, or use our feed to get updates on your favorite podcast software.

Update: Episode index with links, thanks to FBITennis:

Tsitsipas in Toronto 1:17
Performance Byes [pp 45-46 in linked pdf] 8:05
Next Gen One-Handed Backhands 13:29
Sloane Stephens’ Ranking Profile 19:38
Effectiveness of Kamau Murray 27:40
Do the Canadian Results Affect US Open Favorites? 33:00
Dimitrov defending in Cincinnati 37:30
Federer returns in Cincinnati 40:55
Muguruza defending in Cincinnati 45:06
Average Age of ATP Top 50 Declining 48:30
Serve Clock 52:34

Maybe, Finally, The Next Generation is Here

Italian translation at settesei.it

Alexander Zverev is winning Masters titles. Stefanos Tsitsipas is beating top ten players. Denis Shapovalov, Frances Tiafoe, and even Alex De Minaur are making life more difficult for ATP veterans.

For most of the last decade, the story of men’s tennis has been the degree to which the game is getting older. Even now, thirty-somethings hold half of the places in the top ten. Wave after wave of hyped prospects have failed to take over the sport, settling in for a long fight to the top.  On Monday, Juan Martin del Potro, once hailed as the man who would topple the Big Four, will reach a new career-best ranking of No. 3 … six weeks away from his 30th birthday.

At last, though, men’s tennis appears to be getting younger. Teenagers Shapovalov, Tiafoe, and De Minaur are rising just as some of the game’s crustiest vets are on their way out: 36-year-olds David Ferrer and Julien Benneteau are calling it quits this year, tumbling in the rankings alongside the likes of Feliciano Lopez and Ivo Karlovic.

The result is that the average age of the ATP top 50 is falling–something it hasn’t done for a really, really long time. The following graph shows the average age of the top 50 at the end of every season since 1983, plus–the rightmost data point–the mean age of the current top 50:

At the end of 2017, the average age was 29.0 years; it has since fallen to 27.75. That’s bigger than any single-year swing (up or down) in the last 35 years. As the graph shows, there were plenty of “down” years in the late 1990s and early 2000s, but none of them had even half the magnitude of the current drop.

There’s still an enormous gap between the current state of affairs and the days when men’s tennis was young. If we expand our view to the top 100, this year’s shift is less dramatic–with Ferrer, Benneteau, Lopez and others ranked between 51 and 100, that average still sits at 28.1 years, only about seven months younger than the corresponding number at the end of last season. But even that weaker evidence of a youth movement points in the same direction: 28.1 years is the youngest the top 100 has been since 2012.

Barring fundamental changes in rules or equipment, we’re unlikely to return to the teenage-driven game of the early 1990s. But after a decade of waiting, watching, and wondering, we can see some cracks in the greatest generation of men’s tennis. And finally, there’s a group of young players ready to take advantage.