New “Event Records” View at TennisAbstract.com

TennisAbstract.com now offers another way to look at stats for every player on the ATP tour.

The new “Event Records” view shows–you guessed it–records by event, summarizing a player’s performance at a given tournament, including his career record, career tiebreak record, years played, best result, and the usual complement of aggregate statistics such as return points won and break points saved.

To access a player’s event records, click here, in the upper left corner, right next to the link to the head-to-head view I introduced recently:

er1

Then you’ll see something like this:

er2

 

The events names are links, so you can click on any of those to see the full list of matches the player contested at that tournament.

Three columns in the middle of the table–“First” (the player’s first year at the event), “Last,” and “Best” (his best result at the tournament)–are loaded with additional information. Mouseover the data in those columns to see a description of the player’s last match (for “First” and “Last”) and the years in which he achieved his best result:

er3

 

er4

 

If you’re interested in particular subsets of matches, most of the filters in the left-hand column function as they normally do. For instance, let’s say you’re interested in Stan Wawrinka’s performance at various events as a top-ten player:

er5

 

You can also use the filters to reduce the number of tournaments on view. Use the “Level” filter to show only Grand Slams or Masters. Use the “Surface” filter to show only events on a particular surface. I also added a “Minimum Years” filter so that you could limit the list to tournaments that the player entered a certain number of times.

In the context of event records, some of the filters are more useful than others (would anyone ever have a use for tournament-by-tournament records in matches with bagel sets?), but at the very least, there are a ton of tools here to play around with.

Enjoy!

Do Players Get Broken More Often After Failing to Convert Break Point?

The headline is a bit unwieldy, but it refers to one of the most common nuggets of conventional wisdom in tennis. When a player has the opportunity to break and doesn’t do so, this viewpoint holds that they are more likely to get broken in their following service game.

Like so much conventional wisdom, this assumes that momentum plays a role. Break points are crucial moments, and if a player doesn’t capitalize, the momentum will turn against him. That momentum then carries into the following game, and the player who failed to convert gets broken himself.

Or so the story goes.

However, data from almost 3,000 2013 tour-level and qualifying-round matches suggests the opposite. The likelihood that a player holds serve has almost nothing to do with what happened in the previous game.

Let’s start with some general numbers. To make sure we’re comparing apples to apples, I’ve ignored the first game of every set. This way, we compare “games after missed break point chances” to “games after breaks” to “games after holds.” In other words, we’re only concerned with “games after something.” I’ve also limited our view to sequences of games within the same set, since the long break between sets (not to mention other psychological factors) seem to put those multi-set sequences of games in a different category altogether.

Once those exclusions are made, this set of several thousand ATP matches showed that players got broken in 21.7% of their service games. Compare that to break rates after various events:

  • after a hold of serve: 22.6%
  • after a break of serve: 19.3%
  • after a hold including a missed break point chance: 21.2%
  • after a hold including three missed bp chances: 20.9%
  • after a hold including four or more missed bp chances: 19.4%

These are aggregate numbers, not adjusted for specific players, so they don’t tell the whole story. But they already suggest that the conventional wisdom is overstating its case. After failing to convert a break point, players hold serve almost exactly as often as they do in general. In fact, they get broken a bit less frequently in those situations (21.2%) than they do following a more conventional hold without any break points (22.6%).

Let’s see what happens when we adjust these numbers on a match-by-match basis.   For example, if Tomas Berdych gets broken by Novak Djokovic 6 times in 15 tries, we can use that 40% break rate as a benchmark by which to measure more specific scenarios. If Berdych fails to convert break point twice, we would “expect” that he gets broken in 40% of his following service games, or 0.8 times in the two games. Of course, no one can get broken a fractional amount of a game, but by summing those “expected” breaks, we can see what the aggregate numbers look like with a much lesser chance of particular players or matchups biasing the numbers.

Once that cumbersome step is out of the way, we discover that–again, but more confidently–there is virtually no difference between average service games and service games that follow unconverted break points.

In my sample of 2013 ATP matches, there were 5,701 service games that followed missed break point opportunities. Players held 4,493 of those games (78.8%). That’s almost precisely the rate at which they held in other games. Had those specific players performed at their usual level within those matches, they would’ve held 4,488 times (78.7%).

We see the same findings when we focus on the most high-pressure games, ones with three or more break points. This sample contained 722 games in which the server held despite three break points. Servers held the following game 571 times. Had they performed at their usual, average-momentum rate, they would’ve held 570 times.  After holds with four or more break points (206 in all), servers held 166 times instead of an “expected” 162.

There’s no evidence here that these particular service games have different results than other service games do.

Envoi

Momentum, the basis for so many of the beliefs that make up tennis’s conventional wisdom, is surely a factor in the game, but my research has shown, over and over again, that it isn’t nearly as influential as fans and pundits tend to think.

Once we hear a claim like this one, we tend to notice when events confirm it, reinforcing our mostly-baseless belief. When we see something that doesn’t match the belief, we’re surprised, often leading to a discussion that takes for granted the truth of the original claim. Our brains are wired to understand and tell stories, not to recognize the difference between something that happens 77% of the time and 79% of the time.

It may turn out that some players are unusually likely or unlikely to get broken after failing to convert a break point. Or perhaps this particular sequence of events is more common at certain junctures in a match. But barring research that establishes that sort of thing, there is simply no evidence that momentum plays any role in the service game following unconverted break points.

There Is No Analytics Revolution In Tennis

I’m sure you’ve heard about the trend. First, statistics overhauled baseball, and teams in every major sport now employ quants to search out that extra edge. Tennis has lagged behind the others, but with the help of big data, we’re on the cusp of a whole new era.

That’s the story, anyway. Yesterday brought us another example.

What happened in baseball is, quite simply, never going to happen in tennis.

To oversimplify a bit, the “Moneyball revolution” refers to front offices using analytics to identify underrated and underpriced players. To a lesser extent, it refers to deploying those players in a smarter way–say, rearranging the batting order or attempting fewer stolen bases.

In tennis, there are no front offices. Players aren’t paid salaries by teams. And there are no managers to decide how best to use their players.

In short: There are no organizations with both the incentives and the resources to analyze data.

Of course, when people get breathless about all the raw data floating around in tennis, that isn’t what they’re talking about. (No one really thinks Hawkeye data is going to revolutionize, say, the World Team Tennis draft.) Instead, they are implying that the data can be analyzed in such a way to be actionable for players.

That’s an admirable objective. In theory, Kevin Anderson’s coach could look at all the data from all the matches between Anderson and Tomas Berdych and identify which tactics worked, which didn’t, and make recommendations accordingly. Of course, Kevin’s coach is already watching all those matches, taking notes, reviewing video, and presumably making recommendations, so if big data is going to change the game, it needs to somehow offer coaches demonstrably better insights.

With all the cameras pointed at tennis’s show courts, that’s certainly possible. The closest analogue in baseball is the pitch f/x system, which tracks the speed, location, and movement of every pitch. Some pitchers have been able to use pitch f/x data to analyze and improve upon their own performance. The same could eventually happen in tennis. But there are systemic reasons why it hasn’t yet, and those root causes are unlikely to disappear anytime soon.

What needs to change

Hawkeye cameras are aimed at a lot of courts and have the capability of collecting an enormous amount of data. That’s how broadcasts are able to bring you stats like average net clearance and meters run. Those cameras also help generate graphics like those showing where all of a player’s serves landed.

After a match is over, with no calls left to be overturned and no broadcast needs likely to arise, what happens to the data? For all practical purposes, it gets stashed in the attic and forgotten. (Here’s a more thorough explanation.) Contrast that to Major League Baseball, which makes all pitch f/x data available immediately–to the public, for free–and has archived it indefinitely.

If tennis is to see any meaningful analytical breakthroughs, Hawkeye data needs to be aggregated in a single database. Results from one match are sometimes interesting (hey look, Andy’s net clearance is 15% greater than Roger’s!), but if we’re always looking at one match, or one tournament, at a time, we’ll never learn which of these Hawkeye-derived statistics matter, or how much.

IBM, the collector of much of this information, may already maintain some version of that database. But the results are jaw-droppingly uninspiring. On broadcasts, we get the same old stats and graphics. When IBM has ventured into predicting match outcomes, their “millions of data points” are outperformed by my much simpler model.

IBM is the one organization in the sport with the resources to do the kind of analysis that will transform tennis. But they have no incentive to do so. To IBM (and now SAP, in the women’s game), tennis is a public relations opportunity, one that allows them to brand tournament websites and on-screen graphics with their logo. (Not to mention those suspiciously pro-IBM trend pieces linked to above.)

Players might eventually benefit from data-based insights, but only a tiny fraction of them could afford to hire even a single analyst. (Hi Simona! Text me anytime!)

Once again, we have to turn to baseball for a precedent. Even in that immense sport, with its billion-dollar franchises, it was amateurs–outsiders–who did the work that brought about the analytics revolution. Even now, with teams aggressively hiring promising talent from outside the game, many of the most profitable insights still come from independent researchers. If MLB made its data as inaccessible as tennis does, that trend would’ve ground to a halt long ago.

Nice as it is to dream about a better world of tennis data, we’re unlikely to see it anytime soon. Tennis doesn’t have a commissioner, so there’s no one to appoint a data czar, let alone anyone who could convince the alphabet soup of the ATP, WTA, ITF, IBM, SAP, and Hawkeye to aggregate their data in any meaningful way.

Until that happens, and until the data is publicly available, there will be no analytics revolution in tennis. We’ll continue to get what we have now: the occasional Hawkeye stat, free of context, illustrating the same sort of analysis we’ve been hearing for decades.

New “Head-to-Head View” at TennisAbstract.com

I’m really excited to announce some new features on Tennis Abstract — I hope you like them as much as I do.

Let’s start with the Head-to-Head view, which you can access by clicking near the upper left corner of any ATP player’s page. Marin Cilic, for example:

h2h1

Click on the “Head-to-Head beta” link, and you get this:

h2h2

 

As you can tell, there is a huge amount of data available here. What you’re looking at is a statistical summary of every single one of this player’s H2H records at the professional level. (As you’ll see on the page itself, the screenshot doesn’t show it all–there are ten more statistical categories for each H2H, including things like service points won and break point conversion rate.)

By default, the H2H table is sorted by number of matches. But like the standard “Match Results” table on Tennis Abstract, you can sort by most other columns simply by clicking on the column header, like TB (“tiebreaks”) here:

h2h3

 

Thanks to the power of Tennis Abstract’s filters, there’s a lot more you can do with this view. As you’ve seen, the H2H view defaults to a player’s career results. Let’s say, though, that you want to see Cilic’s H2H records only on clay. Use the filters in the left-hand column as you normally would, and select clay courts:

h2h4

 

As usual, you can apply as many filters as you want, so you could look at a player’s head-to-heads in a single seasonat the Challenger level, in deciding sets, or even show a summary of a player’s head-to-heads against all opponents from a single country.

Specifically for head-to-head purposes, I added a new filter: “Minimum matches.” This way, if you’re comparing a player’s H2H stats against several opponents, you can filter out matchups that haven’t occurred very much. Here’s an example, which shows Cilic’s highest H2H winning percentages, minimum five matches:

h2h5

 

I also added another new filter that will come in handy on the standard results tab as well: “Vs Current Rank.” (The separate “Vs Rank” filter, which has always been on the page, filters by opponent rank at the time of the match; the new filter uses the most current rankings.) For instance, here are Cilic’s H2Hs against the current top 10:

h2h6

 

Another neat aspect of the “Vs Curr Rank” filter is the ability to select “Active” or “Inactive” players. (These are determined solely by whether a player is in this week’s ATP rankings.) You could display all H2Hs against active players, or in the traditional Match Results view, quickly identify matches against retired/inactive players.

All of this is available for every ATP player, past and present.

In the process of working on the new features, I made a few other improvements that I hope powerusers will recognize and enjoy. For many statistical columns in both the match results and head-to-head views, I customized the sorting behavior, so matches without stats would automatically go to the bottom. I also made a bit of progress toward making the browser back button work as expected. There’s still some work to do there, but it’s much better than it was a few days ago.

Enjoy!