I agree with this, and I really don't like Kiper. I like McShay, and Cosell.I appreciate the analysis from Greg Cosell. Daniel Jeremiah is another one that I like.
I agree with massraider that no analyst will ever be 100% correct in their calls, and it is easy to pick apart their misses.
Actually I think this is important. It would be great to have someone (or all of us) try to start a compilation of certain analysts picks and misses. I mean what is a good percentage of hits? 60%? 70%? 80%? Wouldn't it be nice to have data on these guys. I mean even over the past couple of years.This will be spectacular. By the end of the thread, all the analysts will suck, and as proof, people will mention one of their misses. If you aren't 100%, then you must suck!
post of the year.This will be spectacular. By the end of the thread, all the analysts will suck, and as proof, people will mention one of their misses. If you aren't 100%, then you must suck!
http://harvardsportsanalysis.wordpress.com/2012/05/25/equally-inaccurate-an-analysis-of-mel-kiper-jr-and-todd-mcshays-draft-rankings/Actually I think this is important. It would be great to have someone (or all of us) try to start a compilation of certain analysts picks and misses. I mean what is a good percentage of hits? 60%? 70%? 80%? Wouldn't it be nice to have data on these guys. I mean even over the past couple of years.This will be spectacular. By the end of the thread, all the analysts will suck, and as proof, people will mention one of their misses. If you aren't 100%, then you must suck!
As the chart above shows, Kiper and McShay have proven to be equally inefficient judges of talent over the past five years. Neither expert’s rankings were a particularly good predictor of how a player would perform compared to the rest of his class. In fact, the average errors listed above suggest that the gurus’ rankings are off by around 35 spots when compared to the player’s actual performance. In other words, a player Kiper or McShay ranked as the 15th-best player in the draft is most likely to actually have been the 40th-best based on CAV to this point in their careers. The root mean square errors (RMSE) imply that Kiper is very slightly less prone to extreme errors than his ESPN counterpart, but that difference is not significant. RMSE severely punishes large errors, so having a comparatively lower RMSE implies that one makes fewer huge errors. However, like the average errors, the RMSE for each scout is enormous.
Indeed, when looking at the lists themselves, it is clear that both Kiper and McShay have, like all draft experts, been prone to extreme hits and misses when compared to the other. In 2006, both had future busts Matt Leinart, A.J. Hawk, Vince Young, and Michael Huff ranked in their Top 10s. But McShay was wise enough to include future All-Pro center Nick Mangold in his Top 25, while Kiper instead opted for Jason Allen. The following year, McShay found more success by ranking Darrelle Revis tenth overall, but the Island himself was nowhere to be found on Kiper’s Big Board. Also that year, both Kiper and McShay smartly pegged Calvin Johnson, Adrian Peterson, and Joe Thomas as three of the four top players in the draft, but both also had JaMarcus Russell and Brady Quinn in their top sevens.
Strong work! This is exactly the sort of thing I was hoping for. Wish we had this for others as well.http://harvardsportsanalysis.wordpress.com/2012/05/25/equally-inaccurate-an-analysis-of-mel-kiper-jr-and-todd-mcshays-draft-rankings/Actually I think this is important. It would be great to have someone (or all of us) try to start a compilation of certain analysts picks and misses. I mean what is a good percentage of hits? 60%? 70%? 80%? Wouldn't it be nice to have data on these guys. I mean even over the past couple of years.This will be spectacular. By the end of the thread, all the analysts will suck, and as proof, people will mention one of their misses. If you aren't 100%, then you must suck!
As the chart above shows, Kiper and McShay have proven to be equally inefficient judges of talent over the past five years. Neither experts rankings were a particularly good predictor of how a player would perform compared to the rest of his class. In fact, the average errors listed above suggest that the gurus rankings are off by around 35 spots when compared to the players actual performance. In other words, a player Kiper or McShay ranked as the 15th-best player in the draft is most likely to actually have been the 40th-best based on CAV to this point in their careers. The root mean square errors (RMSE) imply that Kiper is very slightly less prone to extreme errors than his ESPN counterpart, but that difference is not significant. RMSE severely punishes large errors, so having a comparatively lower RMSE implies that one makes fewer huge errors. However, like the average errors, the RMSE for each scout is enormous.
Indeed, when looking at the lists themselves, it is clear that both Kiper and McShay have, like all draft experts, been prone to extreme hits and misses when compared to the other. In 2006, both had future busts Matt Leinart, A.J. Hawk, Vince Young, and Michael Huff ranked in their Top 10s. But McShay was wise enough to include future All-Pro center Nick Mangold in his Top 25, while Kiper instead opted for Jason Allen. The following year, McShay found more success by ranking Darrelle Revis tenth overall, but the Island himself was nowhere to be found on Kipers Big Board. Also that year, both Kiper and McShay smartly pegged Calvin Johnson, Adrian Peterson, and Joe Thomas as three of the four top players in the draft, but both also had JaMarcus Russell and Brady Quinn in their top sevens.
And perhaps equally important, when. Every year when the combine comes around people gets moved on the basis of the workout that most say doesn't matter (it's all about the tape).You know what would actually be just as interesting? Is seeing who moved who up their board first. There's a lot of sniping about this draftnik and that draftnik moving a guy up his board after everyone else does.
no way Hoge tops the worst list. that is reserved for skip baseless.Merrill Hoge is going to the top of the "worst" list with his latest nonsensical vomit that he would rather have Sams over Clowney! I think he's just stirring the pot and can't be taken seriously.
I'm sorry but this is unbelievably stupid.http://harvardsportsanalysis.wordpress.com/2012/05/25/equally-inaccurate-an-analysis-of-mel-kiper-jr-and-todd-mcshays-draft-rankings/
Quote
As the chart above shows, Kiper and McShay have proven to be equally inefficient judges of talent over the past five years. Neither experts rankings were a particularly good predictor of how a player would perform compared to the rest of his class. In fact, the average errors listed above suggest that the gurus rankings are off by around 35 spots when compared to the players actual performance. In other words, a player Kiper or McShay ranked as the 15th-best player in the draft is most likely to actually have been the 40th-best based on CAV to this point in their careers. The root mean square errors (RMSE) imply that Kiper is very slightly less prone to extreme errors than his ESPN counterpart, but that difference is not significant. RMSE severely punishes large errors, so having a comparatively lower RMSE implies that one makes fewer huge errors. However, like the average errors, the RMSE for each scout is enormous.
Indeed, when looking at the lists themselves, it is clear that both Kiper and McShay have, like all draft experts, been prone to extreme hits and misses when compared to the other. In 2006, both had future busts Matt Leinart, A.J. Hawk, Vince Young, and Michael Huff ranked in their Top 10s. But McShay was wise enough to include future All-Pro center Nick Mangold in his Top 25, while Kiper instead opted for Jason Allen. The following year, McShay found more success by ranking Darrelle Revis tenth overall, but the Island himself was nowhere to be found on Kipers Big Board. Also that year, both Kiper and McShay smartly pegged Calvin Johnson, Adrian Peterson, and Joe Thomas as three of the four top players in the draft, but both also had JaMarcus Russell and Brady Quinn in their top sevens.
Okay I see what you are saying but would not a good analyst be able to predict busts - even if they are highly touted? This could be why Manziel is such an interesting topic this year. People are actually split on him.I'm sorry but this is unbelievably stupid. They're criticizing them for having Lenart, Hawk, and Huff in their top 10's? Well guess where they went in the draft - 10, 6, and 7 respectively.http://harvardsportsanalysis.wordpress.com/2012/05/25/equally-inaccurate-an-analysis-of-mel-kiper-jr-and-todd-mcshays-draft-rankings/
Quote
As the chart above shows, Kiper and McShay have proven to be equally inefficient judges of talent over the past five years. Neither experts rankings were a particularly good predictor of how a player would perform compared to the rest of his class. In fact, the average errors listed above suggest that the gurus rankings are off by around 35 spots when compared to the players actual performance. In other words, a player Kiper or McShay ranked as the 15th-best player in the draft is most likely to actually have been the 40th-best based on CAV to this point in their careers. The root mean square errors (RMSE) imply that Kiper is very slightly less prone to extreme errors than his ESPN counterpart, but that difference is not significant. RMSE severely punishes large errors, so having a comparatively lower RMSE implies that one makes fewer huge errors. However, like the average errors, the RMSE for each scout is enormous.
Indeed, when looking at the lists themselves, it is clear that both Kiper and McShay have, like all draft experts, been prone to extreme hits and misses when compared to the other. In 2006, both had future busts Matt Leinart, A.J. Hawk, Vince Young, and Michael Huff ranked in their Top 10s. But McShay was wise enough to include future All-Pro center Nick Mangold in his Top 25, while Kiper instead opted for Jason Allen. The following year, McShay found more success by ranking Darrelle Revis tenth overall, but the Island himself was nowhere to be found on Kipers Big Board. Also that year, both Kiper and McShay smartly pegged Calvin Johnson, Adrian Peterson, and Joe Thomas as three of the four top players in the draft, but both also had JaMarcus Russell and Brady Quinn in their top sevens.
And Jamarcus Russell went #1 overall.
What dumb analysis.![]()
Having said that...Kiper is pretty good but McShay is terrible.
If they did, they'd be successful scouts and/or general managers. Kiper doesn't really predict who is/isn't going to succeed or bust but rather predicts who is/isn't going to be a top draft pick.Okay I see what you are saying but would not a good analyst be able to predict busts? Even if they are highly touted. This could be why Manziel is such an interesting topic this year. People are actually split on him.
Scareface model. I likeRead everyone
Trust myself
Again can see what you are saying about kipper not forecasting nfl futures per say. At the same time those two things are closely correlated I would imagine. And kiper does have a top 25 board. I dunno. So you are saying kipper estimates only where people are going to be drafted without discussing how they will perform in the nfl?If they did, they'd be successful scouts and/or general managers. Kiper doesn't really predict who is/isn't going to succeed or bust but rather predicts who is/isn't going to be a top draft pick.The whole mock draft/analyst thing has gotten out of hand anyway. The thing that Kiper brought and still brings to the NFL was the ability to get to know the players before they were part of a team. It moved fans from being a watcher of a particular team to being a watcher of the NFL as a whole.Okay I see what you are saying but would not a good analyst be able to predict busts? Even if they are highly touted. This could be why Manziel is such an interesting topic this year. People are actually split on him.
To expect the talking heads to be accurate about what player goes where is nonsensical. You're expecting them to predict the future. If they could actually do that they wouldn't be analyzing the NFL draft.
I forget where I read it but even though Kiper isn't any better or worse than anyone else at predicting what player goes where, he's generally pretty good at predicting who is/isn't going to be a 1st rounder.
No differently than anyone else, including NFL teams. He's not generally way off on where guys end up in the draft.Again can see what you are saying about kipper not forecasting nfl futures per say. At the same time those two things are closely correlated I would imagine. And kiper does have a top 25 board. I dunno. So you are saying kipper estimates only where people are going to be drafted without discussing how they will perform in the nfl?
The bigger question is how you determine their hits and misses. What criteria?Gandalf said:Actually I think this is important. It would be great to have someone (or all of us) try to start a compilation of certain analysts picks and misses. I mean what is a good percentage of hits? 60%? 70%? 80%? Wouldn't it be nice to have data on these guys. I mean even over the past couple of years.massraider said:This will be spectacular. By the end of the thread, all the analysts will suck, and as proof, people will mention one of their misses. If you aren't 100%, then you must suck!
I own about 15 yrs worth of Buschbaum's draft guides. Up to this moment his work was the only I've ever paid for. I spent a couple NFL drafts sitting in the press section with Tony Pauline and Adam Caplan when they were somewhat of a team getting started, both good guys. My problem with grading analysts is that so much of a prospect's ranking and eventual production has to do with what's between the ears, how his background and upbringing affects him, what motivates him, etc. Anyone can learn to see physical/athletic traits that can qualify a player to compete on the NFL level. But who has that kind of pertinent background insight besides NFL execs that are paid to look into those things? While they may leak some details, most info of that nature is kept private for their own profit. Analysts are essentially no different than the above average FBG, they just spend more time looking at film. I'll listen to comments from Mayock and that's about it, then make my own judgement on a player.The now deceased Joel Buchsbaum was far and away the best draft pundit. He was the guy that was read by actual league executives, guys like Bellichick, Ron Wolf, Parcells, etc...
Buchsbaum was actually offered NFL jobs but turned them down because he wanted to publish his own material. His guidebooks are scary accurate. The aforementioned real GM types sought out his information. Veteran followers of the draft process know exactly what I'm talking about.
Most of the newer guys are hucksters who use the internet to drive how they rank players. Aggregately I'm largely unimpressed with their analysis, however Greg Cosell is typically very good and I do like Mayock.
I like Kiper as a person. Many years ago when he ran his own show out of his house, I listened to a spot on the radio, called the number, and talked to Mel for about 20 minutes. He was personable and thankful, and I'm happy he's flourished because he built the industry from a commercial perspective. It's great to see a good guy get paid for doing what he loves. His insights, on the other hand, are not better than average.
Mayock and Casserly are good to listen to but I wouldn't buy their material. Bloom is usually a solid read.
They came immediately to mind for me, along with Mayock, I respect his knowledge of positional skill sets, schemes, etc. Maybe Gil Brandt for his general historical perspective, and former GM Pat Kirwan can be insightful, I find both kind of hit and miss at times.I appreciate the analysis from Greg Cosell. Daniel Jeremiah is another one that I like.
I agree with massraider that no analyst will ever be 100% correct in their calls, and it is easy to pick apart their misses.
Xue, Brewtown and tdmills also have provided some pretty good insight.Personally, I like EBF and Bloom. Prove to me that the talking heads are any better than our two guys.
http://forums.footballguys.com/forum/index.php?showtopic=673126&hl=His pre-combine list: When Markus Wheaton is your #1 prospect, Bell/Stacy/Hopkins aren't listed, and Patterson is #18...you shouldnt be on this list.Personally, I like EBF and Bloom. Prove to me that the talking heads are any better than our two guys.
no way Hoge tops the worst list. that is reserved for skip baseless.Merrill Hoge is going to the top of the "worst" list with his latest nonsensical vomit that he would rather have Sams over Clowney! I think he's just stirring the pot and can't be taken seriously.
I think Skip is mainly schtick. It wouldn't surprise me if him and the other loudmouth on his show flip a a coin as to which side they take on some subjects.no way Hoge tops the worst list. that is reserved for skip baseless.Merrill Hoge is going to the top of the "worst" list with his latest nonsensical vomit that he would rather have Sams over Clowney! I think he's just stirring the pot and can't be taken seriously.Hoge has had way too many concussions what is Baseless excuse?
I have been a fan of Stoners work for quite awhile. I also like Josh Norris's work quite a bit as well as yourself. I am not familiar with Liskiewitz at all, thanks for the suggestion.So many good evaluators out there, and as you get more familiar with their work, you start to see which positions they are best at projecting and which might be their weaknesses.
I have made a list of my favorite draftniks on twitter
In particular I want to call attention to a few not mentioned yet in this thread:
- Josh Norris (Rotoworld)
- Eric Stoner (Draft Mecca)
- Andrew Parsons (Draft Mecca)
- Josh Liskiewitz (GM Jr)
True. I pretty much would give people a free pass in TRich. However on the flip side, I would give mad props to anyone who said, you know, I am not drafting this guy.The bigger question is how you determine their hits and misses. What criteria?Gandalf said:Actually I think this is important. It would be great to have someone (or all of us) try to start a compilation of certain analysts picks and misses. I mean what is a good percentage of hits? 60%? 70%? 80%? Wouldn't it be nice to have data on these guys. I mean even over the past couple of years.massraider said:This will be spectacular. By the end of the thread, all the analysts will suck, and as proof, people will mention one of their misses. If you aren't 100%, then you must suck!
How do you treat a pick on Trent Richardson? Hakeem Nicks?
These guys at Draft Mecca have not even ranked their RBs yet?? What are they waiting for? Everybody else's opinion??So many good evaluators out there, and as you get more familiar with their work, you start to see which positions they are best at projecting and which might be their weaknesses.
I have made a list of my favorite draftniks on twitter
In particular I want to call attention to a few not mentioned yet in this thread:
- Josh Norris (Rotoworld)
- Eric Stoner (Draft Mecca)
- Andrew Parsons (Draft Mecca)
- Josh Liskiewitz (GM Jr)
would you rather they put out rankings they are not prepared to post? Unfamiliar with Liskiewitz, but the other three are solid. Norris rankings are often puzzling though, great evaluator, but translating to paper seems off for him.These guys at Draft Mecca have not even ranked their RBs yet?? What are they waiting for? Everybody else's opinion??Experts would have them ranked!!So many good evaluators out there, and as you get more familiar with their work, you start to see which positions they are best at projecting and which might be their weaknesses.
I have made a list of my favorite draftniks on twitter
In particular I want to call attention to a few not mentioned yet in this thread:
- Josh Norris (Rotoworld)
- Eric Stoner (Draft Mecca)
- Andrew Parsons (Draft Mecca)
- Josh Liskiewitz (GM Jr)
http://www.draftmecca.com/players.php?position=rb
I would not give mad props as No One who is consistently good at ranking players and prognosticating could have/should have predicted a Trent bust. Trent was a lock 1.1 and lock to succeed.True. I pretty much would give people a free pass in TRich. However on the flip side, I would give mad props to anyone who said, you know, I am not drafting this guy.The bigger question is how you determine their hits and misses. What criteria?Gandalf said:Actually I think this is important. It would be great to have someone (or all of us) try to start a compilation of certain analysts picks and misses. I mean what is a good percentage of hits? 60%? 70%? 80%? Wouldn't it be nice to have data on these guys. I mean even over the past couple of years.massraider said:This will be spectacular. By the end of the thread, all the analysts will suck, and as proof, people will mention one of their misses. If you aren't 100%, then you must suck!
How do you treat a pick on Trent Richardson? Hakeem Nicks?