Well, I go through about a gallon of whole Milk a week. I also get plenty of water, veggies, etc.
I'm still young IMO, but I've known a few guys around me having stones. I have not. Can't really speak to the science behind the milk concern. I assume it relates to calcium intake, or mineral imbalance, if there is anything to it.
Have you tried searching? Someone may have already posted info on this.