The way I look at it is this:
Buy organic, horomone-free, grass fed, whatever if possible. There has been some science that has shown negative effects from "modified" foods and there are even articles on this site regarding this topic. However, I don't think its an absolute disaster if you don't buy this way.
Milk is good for you from a nutrient standpoint and I'm sure its much better than sodas and alcohol. Could it perhaps help you maximize testosterone levels? Possibly. And if that's the name of the game for you, try to find the more natural versions of food. I don't think you can go wrong with Mother Nature's version.