The name Brett Favre is a widely recognized gold standard at quarterback. Hall-of-fame lock, extremely popular, known for his toughness and leadership. The prototype for what a quarterback should be.
Sure, he put up terrible numbers after the Pack gutted the offensive line in the offseason, lost its best WR in the opener and had its entire stable of running backs knocked out for the season. You think TO was concerned with those numbers when he made those comments? Of course not. He was taking the name every casual fan associates with grit and toughness at the QB position, and saying McNabb wasn't that.
If TO had said they'd be better off with Joey Harrington, that could be taken as a racist statement. But Brett Favre? I don't think so.
I do agree that TO is a jackass and no one should have to deal with what he put McNabb through. But this was never a racial thing until McNabb made it one, and that was stupid and immature of him.