What's new
Fantasy Football - Footballguys Forums

This is a sample guest message. Register a free account today to become a member! Once signed in, you'll be able to participate on this site by adding your own topics and posts, as well as connect with other members through your own private inbox!

Consistency-Corrected Fantasy Rankings (1 Viewer)

Otis

Footballguy
Why don't we account for consistency in our fantasy rankings?

(Note: this thread applies to head-to-head leagues, which I presume most of us play in)

It seems to me that it should be such a no-brainer that the more consistently a player scores a "good" amount of points for his slot in the lineup (WR1, WR2, etc.), the more valuable he is.

Let's consider a spot in your lineup. For our hypothetical here, let's say WR1.

You have a choice between drafting two players, both of whom will have the same total fantasy points at the end of the season:

Player A: Player A is streaky. He puts up good fantasy points but eratically, throwing up stinkers here and there but also some absolute monster games (that could potentially carry you for those weeks).

Player B: Player B is Mr. Consistency. He puts up a very consistent number of points every week. He alone won't win a game for you, but he won't lose one for you either.

Now let's make the following assumption:

ASSUMPTION: The rest of your lineup scores their weekly average every single week.

There is really nothing else you can do for purposes of the analysis as to this WR1 spot. This is the variable, and the rest has to be the control.

There is no benefit to having Player A. He's more a liability to your lineup than a detriment. Why?

Assuming the rest of your team puts up its weekly average, and this one guy blows up that week, if you are significantly better than the other team, his extra points are essentially worthless. Those points would have been better spent in another week in a close matchup. So now you've blown the doors off your opponent that week, but many of those points are "wasted." Remember, in head-to-head leagues, a one point win is the same as a 50-point blowout.

Ok, but what if you are significantly worse than your opponent, and you would have lost that week if not for Player A having a monster game? Well, if you are significantly worse than your opponents that often, odds are that -- unless you get very lucky -- you're not going to win the league anyway. So it's almost not even worth discussing. Even if you pull out that week, Player A will underperform his average in most other weeks and be detrimental to your lineup. Assuming the rest of your team can't have a "blow up" game every single week (which, by definition, isn't possible, since your team is that much worse than others in the league), eventually Player A's underperformance will cost you games. He could be trading you this one win for several losses. Again, in a head-to-head league, all that matters is the W and L columns, and not the scoring differential.

Here is a link to two charts from this past season for WR1 players. The top chart is for a Player B type (consistent). The second chart is for a Player A type (inconsistent). I'm not going to bother discussing the scoring system, because the details of the scoring are not hyper-important here. Just assume it's close to standard scoring. What matters for my purposes here are the shapes of the charts.

Looking at the charts, it seems readily apparent to me that you would much, much rather have Player A than Player B in your lineup as your WR1. You'd probably draft Player A over Player B if you had the option coming into the season.

In fact, even though Player B outscored Player A over the course of the entire season, I think the charts and the discussion above provide some serious motivation to take the guy who scores less total points (again, we are talking about head-to-head leagues here) but puts up good points for his slot in the lineup much more consistently.

Now, the italicized part above is important, because pretty much all we account for in our rankings are the total season fantasy points, along with modifications based on situation, the player's development, talent, changes in situation, etc. As far as I can tell though, the fantasy community is not using any metric based on constency. The metric is based on total points.

Who are Player A and Player B?

Player A is the #3 dynasty WR on the FBG rankings.

Player B is the #16 dynasty WR on the FBG rankings.

I'd bet the gap is similar in most peoples' rankings and on most draft boards, and would be large regardless of whether it is a dynasty league or not. In pretty much any fantasy ranking you can imagine, I would suspect that Player A would be ranked substantially higher than Player B.

Player A is Chad Johnson

Player B is Plaxico Burress

Chad Johnson significantly outscored Burress in exactly TWO weeks last year (10 and 11). A couple other games were close, and Burress outscored Johnson in the vast majority. Johnson had more total points on the season, but look how many were "wasted" points in two weeks. Plus, with CJ on your roster, you have to plug him in almost automatically as your WR1. So for every week other than 10 and 11, he's practically killing you with his clunkers.

This is an extreme example, but I think one that makes the point clearly.

Accordingly, my theory is that fantasy rankings could potentiall be much improved if we could account for consistency (which nobody does right now) -- to do that, I would suggest multiplying the rankings by a "Consistency Factor," which will work to bump players up and down the rankings.

I'm too lazy to work through the hard math, but there are plenty of people here who are much smarter than I am and who could put together the formula. My guess is there is some basic statistical analysis you could do to determine the deviation from the average each week to come up with some kind of Consistency Factor, and then apply that consistency factor to what used to be our final rankings (arrived at using traditional analyses) to come up with consistency-weighted rankings that, at the end of the day, may much more accurately reflect players' true fantasy values.

Discuss.

 
The only potential flaw I've found in the theory so far -- if "player consistency" is not consistent from year-to-year, it may not be very helpful.

As an example, in 2005 Burress had a much more inconsistent season on a weekly basis. Accordingly, had you bumped him down in your rankings based on the inconsistency factor coming into 2006, you could potentially have missed out on what could have been the most consistent WR this year.

I've only looked at two players, though, and we'd obviously have to extend the sample size significantly.

 
I think your analysis is correct. If your team is good you want consistent players. If your team is not among the best in the league you want inconsitent players who can put up huge weeks. The problem is that Doug Drinen did an analysis of this a few years ago and found that consitency in year N was not correlated with performance and/or consitency in year N+1. Therefore it is nearly impossible to predict prior to the season which players will be consistent and which will be inconsistent.

 
I think your analysis is correct. If your team is good you want consistent players. If your team is not among the best in the league you want inconsitent players who can put up huge weeks. The problem is that Doug Drinen did an analysis of this a few years ago and found that consitency in year N was not correlated with performance and/or consitency in year N+1. Therefore it is nearly impossible to predict prior to the season which players will be consistent and which will be inconsistent.
Yup, this is the concern I had in the post above. If that study really is accurate, then I guess weekly consistency can't be predicted. :unsure:

 
The only potential flaw I've found in the theory so far -- if "player consistency" is not consistent from year-to-year, it may not be very helpful.As an example, in 2005 Burress had a much more inconsistent season on a weekly basis. Accordingly, had you bumped him down in your rankings based on the inconsistency factor coming into 2006, you could potentially have missed out on what could have been the most consistent WR this year.I've only looked at two players, though, and we'd obviously have to extend the sample size significantly.
can you imageshack the same two players for their 2005 output?
 
I think your analysis is correct. If your team is good you want consistent players. If your team is not among the best in the league you want inconsitent players who can put up huge weeks. The problem is that Doug Drinen did an analysis of this a few years ago and found that consitency in year N was not correlated with performance and/or consitency in year N+1. Therefore it is nearly impossible to predict prior to the season which players will be consistent and which will be inconsistent.
Yup, this is the concern I had in the post above. If that study really is accurate, then I guess weekly consistency can't be predicted. :cry:
That is my recollection. I couldn't find the article in a quick search around pro-football-reference but you could probably PM Drinen for a link. Maybe even post it here for the rest of us. :(
 
I think your analysis is correct. If your team is good you want consistent players. If your team is not among the best in the league you want inconsitent players who can put up huge weeks. The problem is that Doug Drinen did an analysis of this a few years ago and found that consitency in year N was not correlated with performance and/or consitency in year N+1. Therefore it is nearly impossible to predict prior to the season which players will be consistent and which will be inconsistent.
Yup, this is the concern I had in the post above. If that study really is accurate, then I guess weekly consistency can't be predicted. :goodposting:
That is my recollection. I couldn't find the article in a quick search around pro-football-reference but you could probably PM Drinen for a link. Maybe even post it here for the rest of us. :yucky:
That is exactly the analysis I had in mind readnig your second post Otis... I'll try to dig it out...
 
The answer, my friends, is CRANK.

Get high on Crank

Matt Waldman is known as Wildman on these boards (and FF Today) and he is a great resource in and of himself.
Standard deviation doesn’t take into account what fantasy owners really need know: how consistently a player averages at least the desired amount of fantasy points per game. Fantasy owners actually desire the “inconsistency” that occurs because a player had several performances significantly above the desire fantasy points per game average. Priest Holmes didn’t score less than 12 fantasy points in a game last season, but his standard deviation is among the highest of all backs. Forgive The Gut Check, but he’d gladly take this kind of inconsistency—especially with a fantasy point per game average of nearly 25 points!
 
These are both nice articles but they fail to answer the more important question. How do you predict which players will be consistent. Nobody would argue that having a player who consistently scores more than a given baseline is a great idea. The trick is how do you predict this.For instance, from the first article you see this:

So how does one incorporate the rookies or players rebounding from down years due to injury into Crank scores? Ahman Green is a good example. Here are his scores from 2003-2004 and for both years separately:

Green Extremes

2003-2004 G F Pts/G Crank

Ahman Green 31 17.32 59.58

2003 G F Pts/G Crank

Ahman Green 16 21.56 90.29

2004 G F Pts/G Crank

Ahman Green 15 12.79 32.85

The two years separately represent two extremes of Green’s productivity. Yet averaged together, Green would belong in the third tier of RBs alongside Martin, Westbrook, and Julius Jones—definitely a reasonable projection. Crank scores from previous seasons or averaged scores from combined seasons is a solid projection method for veterans coming off injury or disappointing seasons.
But doesn't the fact that 2003 Ahman Green had a really high Crank score and 2004 Ahman Green had a really poor Crank score indicate that year to year correlation is pretty low?
 
FlaVVed!

Not for content, but for artistic mis-representation. :loco:

While I like where you went with this, the bar graphs are not crafted to the same scale. The bar representing the 20 pts that player "B" scored in week 18 is almost exactly the same height as the bars representing the whopping 41 and 39 pts scored in weeks 10 and 11 by player "A."

This visual trick draws the viewer to player "B" over player "A"...

...who I agree, using the logic outlined in your post, is the player of choice in the long run.

Nice work. :D

 
The only potential flaw I've found in the theory so far -- if "player consistency" is not consistent from year-to-year, it may not be very helpful.
Bingo. I didn't even read the OP yet, but this is true. I'll get a link in a bit.
 
'Otis said:
The only potential flaw I've found in the theory so far -- if "player consistency" is not consistent from year-to-year, it may not be very helpful.
Bingo. I didn't even read the OP yet, but this is true. I'll get a link in a bit.
Update?
Drinen did a piece on it in his really old articles on Pro-Football-Reference (it's the "Big Gamers or Steady Eddies?" article). Unfortunately for us, that link happens to be the only broken one on the entire page. Fortunately for us, though, we have the Internet Wayback Machine, which fixes that link and leaves us with the original article in all its glory.The article doesn't address whether consistency is consistent between year N and year N+1, but it does point out that inconsistent RBs actually hold their value better in year N+1. Not quite the result you were looking for, but a result nonetheless.

As for whether consistency really is consistent from season to season... anecdotally, I'd go back to the two WRs you chose to use in your original example. You mentioned that Plaxico Burress was extremely consistent that season despite being very inconsistent the year before. You also mentioned that Chad Johnson was extremely inconsistent that season, but if you look back, he had actually been the model of consistency the year before that (4 or more receptions in 14 games, 50+ receiving yards in 15 games).

 
Both Crank (by Waldman) and Quality Starts (by me) look at this sort of info.

Can't post links to either right now, but you can look at older articles at FBG plus whatever Chase and Doug are pointing to as well.

 
Painting with a broad brush, but...

Generally speaking there's no such thing as 'consistency'. And nominal efforts to define it just end up highlighting players who score a lot of points. (Higher average points, with a similar standard deviation means you'll clear the 'consistent' bar more often.)

To the degree that a player has an unusually low standard deviation around his average in one year he can look 'consistent' but the unusually low standard deviation is almost never repeated across a long period of time.

One exception is players who rely on receptions in PPR, but don't score TDs. They're consistent, but most of the time it's hard to score enough FF points to be strongly relevant if you're not scoring TDs.

IOW... don't waste your time. Just draft players who are going to score more points.

 

Users who are viewing this thread

Back
Top