Tis the season to look at polls. If you are interested in this election (and who isn’t?) you might find yourself spending much of your day looking at the latest polling data. And what do these polls show? From Nate Silver’s site – fivethirtyeight.com – we see that last summer it looked like Barack Obama was predicted to win. And then around the Republican convention, John McCain took the lead in the polls. More recently, the polls once again predict an Obama victory.
In evaluating the quality of these predictions we don’t look at just one poll or one snapshot. To get an accurate sense of what’s going to happen, we consider a number of snapshots. And hopefully, as the amount of information we gather accumulates, our forecast improves.
Polling NBA Rookies Before the Preseason
Our analysis of NBA rookies follows this basic philosophy. As we consider a variety of snapshots we hope to zero in on an accurate forecast.
The first snapshot we will consider is what the players did in college. As noted in September – and Table One – the college numbers indicated that Michael Beasley and Kevin Love will be productive NBA players (and Greg Oden can be included in this list). Meanwhile, the college numbers of Russell Westbrook, Brook Lopez, Jerryd Bayless, D.J. Augstin, Joe Alexander, O.J. Mayo, Eric Gordon, Robin Lopez, and Anthony Randolph suggested that these players may not be prolific producers of wins in the NBA (at least not during their rookie seasons).
Table One: Reviewing the 2008 NBA Draft with Win Score
Of course, this is just a suggestion. A few months ago we saw a second set of numbers in the NBA’s summer league. And these numbers… okay, it doesn’t look like summer league numbers mean much (at least that was my argument last summer).
The Preseason Numbers
In the past few weeks, though, new numbers have come in. We have now seen these rookies in the preseason. Now preseason basketball is not the same as the regular season. Teams don’t play their starters much of the game and many of the players on the court are never going to appear when the games count. Nevertheless, there does appear to be a link between preseason performance and what see in the regular season.
In 2006-07 and 2007-08 there were 34 rookies who played at least 100 minutes in the preseason and 500 minutes in the subsequent regular season. For these 34 rookies we see a 0.81 correlation between Win Score per minute in the preseason and the regular season. In other words, 66% of the variation in what a rookie does in the regular season is explained by what he did the preseason (below I explain the difference between correlation and explanatory power)1.
If we add in what we learned in college last year, our explanatory power improves. When we consider both Win Score per minute in college and in the preseason, we are now able to explain 75% of the variation in regular season performance (by the way, this doesn’t mean that college performance only explains 9% of NBA performance). In sum, it looks like we now know something.
Table Two: Preseason 2008 – The Rookie Numbers
Table Two reveals what we have learned. Both the college and preseason numbers indicate that Greg Oden and Kevin Love will be above average NBA players as rookies. In other words, an average NBA player posts a WP48 [Wins Produced per 48 minutes] of 0.100 and both Oden and Love are expected to eclipse this mark.
Now most rookies are below average. In fact, an average rookie only posts a 0.042 WP48. If we consider the mark of an average rookie, then it looks like Mario Chalmers, Ryan Anderson, Mareese Speights, Michael Beasley, and O.J. Mayo – will be above average freshmen.
For a few other rookies, though, we now have two snapshots that should give their teams (and fans) some concern. The model – which looks at both college and preseason performance — projects that Derrick Rose, Brook Lopez, Eric Gordon, Jerryd Bayless, Russell Westbrook, D.J. Augustin, and Joe Alexander will be below average for rookies. And a below average rookie is really not someone who will help a team win many games.
A Few More Thoughts
Other notes on these results:
- The model only projects Greg Oden to be just a bit above average. Oden, though, was hurt in college so this projection is probably too low. I would guess that Oden’s rookie numbers will come closer to what we saw in the preseason. In other words, I expect Oden to be the most productive rookie in 2008-09.
- Beasley looked great in college, but his preseason numbers are quite bad. So the second round of numbers on Beasley should leave Miami fans unhappy.
- In contrast, Memphis fans should become more optimistic. O.J. Mayo didn’t play well in college. But in the preseason he was close to average for an NBA player. So the projection on Mayo has now been upgraded from below average as a rookie to above average for a first-year player (but still below average for an NBA player).
As always, we need to close this discussion by noting that although college and preseason numbers tell us quite a bit, we are still left with just a projection. For some of these players the projection for the rookie season will be incorrect. Furthermore, these projections are not telling us anything about performance beyond the rookie season (although there is a link between rookie performance and what a player does the rest of his career). So it’s possible that a number of rookies with bad numbers today will develop into productive NBA players in the future. And of course, it’s also possible that won’t happen.
– DJ
1– The correlation coefficient -or “r” – tells us the strength and direction of a relationship. But if we want to know how much of the variation in a dependent variable (what we are trying to explain) is explained by our model, we turn to r2. For a model with only one explanatory variable – such as a model linking preseason performance to regular season performance – r2 is simply the correlation coefficient squared. So a correlation coefficient of 0.81 between preseason and regular season performance tells us that we are explaining 66% (0.81 * 0.81) of the variation in regular season performance (with just preseason numbers).
It’s important to remember that r2 is really the ratio of the explained sum of squares (or how much variation our model explains) to the total sum of squares (how much variation there is to explain). So of the variation that exists in regular season performance, preseason performance explains 66%. If we consider both preseason and college performance, we can then explain 75% of this variation. And again, this doesn’t mean that college performance only explains 9% of NBA performance.
The WoW Journal Comments Policy
Our research on the NBA was summarized HERE.
The Technical Notes at wagesofwins.com provides substantially more information on the published research behind Wins Produced and Win Score
Wins Produced, Win Score, and PAWSmin are also discussed in the following posts:
Simple Models of Player Performance
What Wins Produced Says and What It Does Not Say
Introducing PAWSmin — and a Defense of Box Score Statistics
Finally, A Guide to Evaluating Models contains useful hints on how to interpret and evaluate statistical models.
Joe
October 27, 2008
Malik Hairston just got cut.
OJ Mayo
October 27, 2008
OJ Mayo was and always will be well above average. I am not sure if you watched too many of his games but starting tomorrow night the talk will all end and the truth will be seen.
Owen
October 27, 2008
I look forward to holding you to that prophecy…
John W. Davis
October 27, 2008
OJ Mayo do you realize that’s Rudy Gay’s team.
You also better be nice to Mike Conley and Kyle Lowry or you wont get the ball very much.
Mountain
October 27, 2008
Moving beyond the numbers I’d guess Anderson won’t deliver quite as strongly as the list suggests while I’d guess Arthur, Hibbert and Hickson do better than these numbers suggest.
topfetch
October 28, 2008
Yes it is still Rudy Gay’s team for now.
Sam
October 28, 2008
Watching Rose, he wins games. He’s won one already, anyways. :P [Hopefully he wins another tonight.]
Charles Follymacher
October 29, 2008
Of all the NBA team, the Spurs seem the most appreciative of the scoring-isn’t-everything philosophy yet even they couldn’t find space for Hairston, who projects to be about the fifth best rookie this year.
Hairston’s problem is that he is a weak all-rounder. He doesn’t suck at anything in particular, but neither does he really stand out in any department. After starters, teams seem to want only specialists or “energy” guys.
Hairston’s got a lot of basketball smarts, but apparently if that’s your “specialty,” that gets you a job in Europe. :(
Charles Follymacher
October 29, 2008
p.s. where’s Maarty Leunen?
mrparker
October 30, 2008
Why use preseason numbers. Its such a small sample size. My friend over at bcftoys.blogspot is getting a comeuponce right now for using only 5 years of data to try and predict future performance of college teams. That small a sample size tells us that Stuckey is going to be a good player which we all know is not the case.
I’m being to forceful with my argument. The reason why I’m writing is to state my opinion that the 3 best rookies will be Bayless, Rose, and Love. That is by wow standards which I consider to be “the standard”.
dberri
October 30, 2008
mrparker,
The data says preseason numbers are correlated with what happens in the regular season. A larger sample would likely have a better correlation. Nevertheless, even with this small sample we are learning something.
harmoniousways
October 30, 2008
Maarty Leunen is playing for Darussafaka in the Turkish Basketball League. The Rockets still hold his rights.