I may be in the minority (maybe, maybe not) in that I am not a huge fan of special teamers having great chances at becoming HOFers. The best special teamers are generally players that were not good enough to be regular players on offense or defense (let alone top producers on offense or defense).
Another issue is that special teamers only play a handful of snaps a game and the huge majority of the time the results of a play are not noteworthy. As a for instance, if a player did a great job downing a kick at the one yard line, how many times might that happen in a year? Three? But that would only save 57 yards over the course of a season.
The same can be said about most kick returners, A couple of guys will break a long return for a TD or two, but without those 2-3 long returns, their return numbers would be similar to any number of returners in the league. Last year, Andre Roberts led the league with a 30 yard kickoff return average. With most kickoffs going into the end zone these days, teams get 25 yards plus where the kicker received the ball for free (since touchbacks start at the 25 yard line). Fielding a kickoff halfway into the end zone and running it to the 25 yard line would net the same field position as just taking the touchback (without risking a fumble). Based on that, is there really a huge difference in field position when maybe a couple of kickoff returns per year amount to something substantial?
A case could also be made that there really isn't a ton of difference between place kickers. As a for instance, in 2020, there were 32 kickers that attempted at least 10 FG attempts. The #10 kicker based on percentage of kicks made converted 92.3% of his attempts. Would having the best kicker last year in terms of accuracy vs. the 10th best kicker have made that much difference?
Let's use recently retired and NFL all-time leading scorer Adam Vinatieri as another example. The man scored 2,673 points from 1996-2019. I mean, what a legend! But if you had the choice of taking Adam V's point total in that time or the summation of the 15th leading scorer from each individual season in that time added together, who would you pick? Vinatieri would win that comparison . . . BARELY. Vinatieri scored 2,673 points in that time. The 15th best kicker in scoring each year added all together would have scored 2,633 points. Sure, we all remember a handful of clutch kicks he made in his early years with NE, but Vinatieri across his career was about average in terms of scoring points for a kicker . . . he just did it for a very long time . . . and 24 years played got him enough longevity to amass a ton of points scored.
You suggested Tasker. I would counter with a current generation S/T player Matthew Slater. Is there much of a difference between them? Tasker played 14 seasons, went to 4 SB's, and was a Pro Bowler 7 times. Slater has played 13 seasons, went to 5 SB's, was a Pro Bowler 9 times and was selected first team All Pro twice and second team All Pro twice. I wouldn't think either one of them have great HOF numbers or chances.
Tasker has a career AV of 7 (yes, that is for his entire career). Slater's career AV is only 3. Taker's HOF Monitor score is 15.38. Slater's is 26.50. Were either one of them all that special in terms of impacting the games they played in? A lot of the geeky advanced stat metrics base rankings and player scores based on value above replacement, and the sad truth is that special teamers really don't impact the game all that much (or very often) and they aren't on the field for many snaps.
There are several positions like that in football. Fullback. Short yardage / goal line back. Receiving back. Blocking tight end. Nickel cornerback. Third down edge rusher. Long snapper. They are all important positions at times, but they aren't really the marquee or banner headline positions that have huge impact on a game's outcome over and over again. It's like a utility infielder, a pinch hitter, middle inning reliever, or a lefthanded relief specialist that only comes in to face a single lefthanded batter. If these players were elite athletes and better at the game, they wouldn't have been in those roles in the first place.
So sure, Tasker was a great special teams player. But that also means he wasn't an elite offensive or defensive player. Statistically, even the best special teamers weren't leaps and bounds above the rest of the league and the better known ones didn't move the needle a ton in terms of their impact on a game week in and week out. If they start inducting special teamers or specialists, that will mean other players that played a ton more snaps won't get in (unless they start elected way more players than they do now).