I'm not dissenting, though what's your opinion on fermented dairy products, it seems that some of the ill effects are addressed (if I recall correctly).
Low level milk protein sensitivity (similar to gluten sensitivity) elevated cortisol, bowel irritation. At least I believe that's the paleo viewpoint. I for one have tried GOMAD I always felt like I needed a benadryl and my shits were horrendous.
I basically buy into the premise that we haven't had enough time to adapt to cow's milk, grains, legumes, etc.