{"id":482,"date":"2011-08-23T10:30:12","date_gmt":"2011-08-23T14:30:12","guid":{"rendered":"http:\/\/heavytopspin.com\/?p=482"},"modified":"2011-08-23T10:30:12","modified_gmt":"2011-08-23T14:30:12","slug":"is-the-us-open-draw-truly-random","status":"publish","type":"post","link":"https:\/\/www.tennisabstract.com\/blog\/2011\/08\/23\/is-the-us-open-draw-truly-random\/","title":{"rendered":"Is the US Open Draw Truly Random?"},"content":{"rendered":"

Italian translation at settesei.it<\/em><\/a><\/p>\n

Last week, an ESPN “Outside the Lines” article called into question<\/a> the fairness of the U.S. Open main draw. \u00a0A researcher discovered<\/a> that the top two seeds (both men and women) have gotten very easy first-round assignments.<\/p>\n

This is one small step away from a direct accusation of draw-rigging by the USTA. \u00a0It’s a serious claim, and while the article’s author leans heavily on a single academic who supports the methodology used, it’s not at all clear that anything unacceptable is going on.<\/p>\n

What they found<\/strong><\/p>\n

For some reason, the study focused on the top two seeds. \u00a0It’s not at all clear why it did so–I have no idea what the USTA’s motive would be for rigging the draw in favor of the top two seeds, regardless of their identity. \u00a0Sure, there were a few years when a Federer-Nadal final would have been particularly mouthwatering, or when American viewers craved a Serena-Venus showdown in Flushing, but why would the USTA be tweaking a draw in favor of Gustavo Kuerten? \u00a0Marat Safin? \u00a0Amelie Mauresmo? Dinara Safina?<\/p>\n

For the moment, let’s set that major concern aside. \u00a0To quantify the difficulty of each player’s first-round opponents, the ESPN study invented a metric called “difficulty score.” \u00a0We’ll come back to “difficulty score” in a bit.<\/p>\n

A simple look at the lists they assembled of first-round opponents does suggest that something untoward is going on. \u00a0In the last ten years of men’s draws, a top-two seed has faced a top-80 opponent only four times, and not once in the last five years. \u00a0Seeded players should face top-80 opponents about half the time.<\/p>\n

If we are truly interested in the first-rounders assigned to top-two seeds, it’s clear that these players have<\/em>\u00a0been given an easier path than what would be statistically expected. \u00a0But it’s not yet clear that it’s anything other than good luck.<\/p>\n

Breaking down “difficulty score”<\/strong><\/p>\n

Here’s the explanation of the metric that ESPN used:<\/p>\n

So if a top two seed faced the 33rd-ranked player in the first round, he\/she would get a difficulty score of 0.995 for that round; if he\/she faced the 128th-ranked player in the first round, the score for that round would be 0.005. An average opponent (ranked around 80th or 81st), would correspond to a difficulty score near 0.500, which should be the average difficulty score over several years of draws.<\/p><\/blockquote>\n

I don’t understand why the ESPN study needed to switch from ordinal rankings (1 to 128) to difficulty scores between 0.005 and 0.995. \u00a0But I replicated the work using ordinal rankings instead of difficulty scores, and came up with the same results.<\/p>\n

The average first round opponent for the top two seeds in each year’s men’s draw has been about the 98th-best player in the draw. \u00a0Given that seeds can draw anyone from 33 to 128, the average “should” be around 80. \u00a0With difficulty scores, ESPN says that the likelihood of the last ten years of easy draws is 0.3%. \u00a0With ordinal rankings, I found approximately the same. \u00a0The last thing the sports-analysis world needs is another superfluous metric, but at least this one doesn’t appear to be misleading.<\/p>\n

What about better reasons for rigging?<\/strong><\/p>\n

The core problem here is this: Why do we care \u00a0specifically about the draws for the first two seeds? \u00a0<\/strong>Or, why would the USTA care enough to compromise the fairness of the draw?<\/p>\n

As ESPN highlighted, some of the first-round victims are American wild cards. \u00a0Scoville Jenkins, for instance, was fed to the wolves twice, once each against Federer and Roddick. \u00a0If we’re really fishing for an explanation, perhaps the USTA wants to put up-and-coming stars such as Jenkins, Devin Britton, and Coco Vandeweghe on a big stage, either to showcase these players, or to make otherwise pedestrian blowouts more interesting. \u00a0I suppose I’d rather watch Nadal play Jack Sock than, say, Diego Junqueira.<\/p>\n

But that’s ex post facto reasoning of the most blatant sort. \u00a0If the USTA were going to rig the draw, wouldn’t they be more likely to do so in favor of top Americans? \u00a0Or in favor of a broader range of seeds, to better ensure marquee matchups for the second week? \u00a0Or rig second-round matchups for top players, to ensure that the big names make it to the middle weekend?<\/p>\n

If no evidence of draw manipulation appears in any of those other scenarios, it would seem that ESPN discovered something more like the famous correlation between the S&P 500 and butter production in Bangladesh<\/a>. \u00a0If your search for a newsworthy conclusion is sufficiently wide, you’re bound to find something<\/em>.<\/p>\n

The top seeds<\/strong><\/p>\n

As I’ve said, there’s no doubt that the top two seeds in the men’s draw have had an easy go of it in the last ten years, since the draws started seeding 32 players instead of 16. \u00a0The same is true of the women.<\/p>\n

The top two in both the men’s and women’s draws faced an opponent who ranked roughly 98th out of the 128 field. \u00a0The odds of this happening on either side are tiny–about 0.25%. \u00a0The chances that a single tournament would randomly produce draws so easy for the top two men and<\/em>\u00a0women for ten years are effectively zero.<\/p>\n

Beyond the top two, however, any suspicions quickly disappear. \u00a0The average opponent for the top four seeded men has been ranked about 89 out of 128, meaning that #3 and #4 face opponents around #80–dead average. \u00a0The average first-round assignment for the top eight<\/em>\u00a0seeded men has been around 87, meaning that seeds 5-8 face average opponents in the mid-80s. \u00a0Nothing to cause a raised eyebrow there, and the numbers are almost identical on the women’s side.<\/p>\n

To go one step further, there’s no evidence of manipulation in the second-round draws. \u00a0In fact, the top two women’s seeds faced particularly tough 2nd round opponents–there was only a 20% chance that those twenty women would be given as tough of 2nd round assignments as they have.<\/p>\n

Before looking at the draws of U.S. players, a quick summary. \u00a0While the top two seeds were given very low-ranked opponents in the first round, the effect did not extend to the second round, or to any seeds beyond the top two.<\/p>\n

The American draws<\/strong><\/p>\n

If the USTA were to tweak the draws, you’d expect them to do so in favor of the home players, if for no other reason than television ratings. \u00a0But they haven’t.<\/p>\n

Let’s start with the American men. \u00a0The top two ranked American men each year have faced opponents ranked, on average, 79 of 128. \u00a0That’s a bit tougher<\/em> than average. \u00a0If we expand the analysis to the top four ranked Americans, or just seeded Americans, the results stay around average. \u00a0If anyone is manipulating the draws in favor of American men, they are either doing it without regard for ATP rankings, or they aren’t doing a very good job.<\/p>\n

More surprising is the average opponent of all<\/em>\u00a0American men. \u00a0The average opponent of an American man in the last ten years has been 61.2 — considerably lower than 80, in part because unseeded men may draw seeded players in the first round. \u00a0But the average shouldn’t be that low. \u00a0In fact, there is only a 20% chance that American men would be given such a tough assignment.<\/p>\n

Results for the women are mostly similar. \u00a0The top two American women each year have gotten a slightly easy draw–the average opponent rank is 83 of 128. \u00a0Keep in mind, however, that this overlaps with the analysis of the top two seeded women–five of the 20 top-two-seeded women were Americans, and in almost each one of those five cases, those women faced one of the weakest players in the draw. \u00a0In other words, there’s more evidence that the draw is skewed in favor of the top two seeds than the top two Americans.<\/p>\n

As with the men, American women in general have been given tough assignments. \u00a0In fact, there is only a 16% chance that American women would face such tough first round opponents as they have.<\/p>\n

What this means<\/strong><\/p>\n

If the USTA (or anyone else) is messing with the US Open draws, they are doing so in a nearly inscrutable way. \u00a0The only evidence of manipulation is with each year’s top two seeds, as ESPN highlighted.<\/p>\n

The theory I mentioned above–that it might be desirable to pit top players against up-and-coming Americans–is appealing, but also not supported by the evidence. \u00a0Only five of the 20 opponents of top-two men’s seeds (and six of 20 women’s opponents) has been American, despite the fact that the U.S. contributes five or six lowly-ranked wild cards each year, in addition to a disproportionate number of qualifiers.<\/p>\n

It’s an odd situation. \u00a0The first-round opponents of the top two seeds makes for a plausible target of draw manipulation, if not the most obvious one.<\/p>\n

Postscript: One more question<\/strong><\/p>\n

I mentioned earlier that I’d rather watch Nadal play Jack Sock than Diego Junqueira. \u00a0I like up-and-comers, and it’s always interesting to see whether a new opponent forces a top player to change tactics. \u00a0It makes for a more interesting match than Nadal (or any top-tenner) against a 29-year-old who has hovered for years around #100.<\/p>\n

My question, then: If you’re Rafa Nadal, and (presumably) you want to go deep at the U.S. Open, who would you<\/em>\u00a0rather play? \u00a0The American wild card ranked #450, or the veteran ranked #99? \u00a0A tougher question: Sock, or a veteran who was nearly seeded, like Fabio Fognini? \u00a0I can see different players making different choices, but I don’t think it’s clear cut.<\/p>\n

It is the draws of Jenkins, Britton, Glatch–in other words, the Jack Socks of previous years–that give us this evidence of manipulation. \u00a0On paper, the 127th-highest-ranked player in the draw looks like the 127th-best, but in practice, it’s not nearly so clear cut. \u00a0And if these wild cards really are “wild cards,” what looks like an easy draw may not be much easier than yet another dissection of Sergiy Stakhovsky or Albert Montanes.<\/p>\n

It may be true that at some stage, the US Open draws are being manipulated for (and only for) the top two seeds in each field. \u00a0But that doesn’t tell us whether those players are gaining anything from it. \u00a0It’s far from clear that the lowest-ranked players in each draw are the easiest opponents.<\/p>\n","protected":false},"excerpt":{"rendered":"

Italian translation at settesei.it Last week, an ESPN “Outside the Lines” article called into question the fairness of the U.S. Open main draw. \u00a0A researcher discovered that the top two seeds (both men and women) have gotten very easy first-round assignments. This is one small step away from a direct accusation of draw-rigging by the … Continue reading Is the US Open Draw Truly Random?<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[96,118],"tags":[],"class_list":["post-482","post","type-post","status-publish","format-standard","hentry","category-research","category-u-s-open"],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack-related-posts":[],"_links":{"self":[{"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/posts\/482","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/comments?post=482"}],"version-history":[{"count":0,"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/posts\/482\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/media?parent=482"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/categories?post=482"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tennisabstract.com\/blog\/wp-json\/wp\/v2\/tags?post=482"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}