Baylor does have a solid argument though. Baylor has 3 top 15 wins (BYU, OU, OSU) to Bama's 1 (OleMiss). They also have the conference championship and one of their losses is somewhat negated. Bama can't afford to lose by multiple scores.
He's obviously able to build a defense and inspire toughness. I think the jury is still out on building an overall program and incorporating a dynamic offense.