I was referring to
their column discussing the CBS Experts IDP Draft.
And "disgusted" was way too strong a word. Disappointed is the word I should have used. To wit:
Mike Tanier, FootballOutsiders
"I have been involved in an IDP league for 15 years. My summer schedule is flexible. Armed with our KUBIAK rankings and plenty of input from Aaron, I would draft the Football Outsiders team.
The first thing I noticed as I began preparing for the draft was that rosters and lineups for the 12-team league were huge. Each starting lineup requires a quarterback, two running backs, three wide receivers, one tight end, a flex player, two defensive linemen, three linebackers, three defensive backs, a kicker, and a special teams. The 18-player lineups seem unwieldy, but with a 29-man roster to chose from, owners would have plenty of options."
I read Mike's stuff religiously; he's one of the few that breaks down a football play in an easy-to-digest and accurate manner. So, I'll give him the benefit of the doubt with the "unwieldy" comment. But it certainly makes you wonder what kind of league he's played in for those 15 seasons. I quoted this section to point out that the FO drafters were using the KUBIAK projections to draft, which means they see them as applicable to fantasy football.
Aaron Schatz, FootballOutsiders
"This league is completely ridiculous, to be honest. 29 players per team? It seems like the kind of thing that would be fun with your buddies, particularly if you are used to playing in deep baseball leagues. (I play in AL and NL-only "Ultra" leagues, with a dozen teams and up to 40 players including reserves.) However, I’ve always thought that the point of these experts leagues is to be a public example to help fantasy football players get an idea of who they should be drafting, picking up on waivers, and so forth. I can’t imagine anybody out there actually plays in a league that looks anything like this. Who among you owns Channing Crowder or Jerome Harrison on your fantasy team? Nevertheless, we figured Football Outsiders readers would get a kick out of seeing the results and what Mike and I were thinking as we (mostly Mike) drafted. Plus, we’re not sure what is going on with the Boston-area auction league that features a number of FO writers and gets written about in Scramble every year. We usually don’t auction until a week before the season starts, so the results wouldn’t show up in Scramble in time to help anyone."
This was the first of many comments that rubbed me wrong from Schatz. Again, I'm a fan of Pro Football Prospectus, primarily because of the game charting data, but also because Aaron etal have no problem saying that the quest to improve their metric, rating and projection system is a never-ending struggle. Still, there's a huge disconnect here to me. This is an outlet that spends a significant amount of time manipulating data and using statistics to draw their conclusions. There's no question after reading the brief essays about DVOA and DPAR that those manipulations are highly specialized. Why, then, are you saying a deep league such as this is "completely ridiculous" and that you can't imagine that participating has any value to fantasy football players? While the FO business of statistical metrics wasn't built with fake footballers in mind, they certainly market their KUBIAK projections and slant half of the book toward fantasy football. You'd think there'd be a little more understanding of the landscape here.
Schatz
"In doing the IDP projections for the first time, I discovered that weakside linebackers generally get more tackles than strongside linebackers, but the difference is even more extreme in two different defenses: The Tampa-2, and the Gunther Cunningham system. Kansas City is sort of a cross between the two now, I guess, and we think the Chiefs are going to suck, so Edwards is going to have a zillion tackles. Don’t be shocked if he leads the league."
Comments like that in bold are what really have me concerned about their defensive projections and overall football knowledge in general -- at least that of Schatz. If you're going to be selling a projection system, and one that has a huge number of variables, you better understand the basic roles of the defense. I'm glad the system recognized the SLB/WLB dichotomy, but it doesn't inspire confidence that you'll be taking into account the more subtle variables that come into play when you apparently didn't realize such a big issue before you started. And I may be wrong about Edwards -- this draft made me reconsider my late twenties ranking -- but I'll still be surprised if Edwards finishes with more than 95 solos, which is what he'd need to finish in the top ten this year. And the Cato June picked they pimped elsewhere in their review really calls into question what they're pumping into their formula.
Tanier
"My late defensive line picks, Edwards and Tommy Kelly, weren’t my best work. It’s not easy picking defensive linemen three weeks before camp opens."
Again, very disappointing to me coming from an outlet that I'd expect to have a pretty good handle on what's happened during the offseason since they're marketing 2007 projections. I'm willing to give these guys a bit of a pass because they spent the bulk of the offseason compiling a huge database of game data, then researching and writing their book. But it makes you wonder if they spend more time reflecting on past data than considering future issues. No way would I say that FBG knows how every camp situation will break down, but I think we have a better handle than to chalk it up to -- camp hasn't opened yet.
-----------
I think the take home message here is that FO isn't ready to be a major player in the fantasy football business and they probably don't desire to do so. That isn't to say that those of us who play fantasy football can't find them useful. Per my usual mantra, understanding what's hype and what's not is a big part of successfully evaluating talent, then applying it to potential box score production. Some of the metrics, if interpreted correctly, will help you identify some important data. I
really want the game charting data for that reason.Based on the comments in their review of the draft, I elected not to purchase their projections. I bought the book, which is a solid read as always. But I think they're behind the curve a bit in the application of defensive concepts if the above is any indication. They've got the salient raw data, though, and hopefully they'll find a way to interpret it without multiple qualifiers along the way.