well i do think something fishy may be going on there, but cant most fans say that about most conference/rival schools? regardless if it's true or not.
it may be a little of that, but it also must be pointed out that Texas has become a recruiting hotbed the last several years. first UT seized that (TJ Ford, Aldridge, etc.) and used those great players to up their program and now they're landing national recruits (Durant, Bradley, the other kid from Compton, etc.) along with the top players in TX.
the natural reprocussions of loads of TX talent paired with UT not needing all of them will indeed help all the other schools out, ie: Baylor, A&M and even OU.
let's not forget many black families in/around TX are Baptist, Baylor is a Baptist university and a very fine private school as well. there could be worse things for many of these kids.
Drew may be dirty but he's also using Baylor's assets, education, location to momma, Big 12 exposure/tv, etc. to his advantage. it's not his fault that Baylor coach after Baylor coach has been crummy in the past.