Depends which way you look at it. People will say the dietary cholesterol isn't an issue, that it doesn't have a negative effect human health. I haven't come across any convincing scientific data that shows that it does negatively effect human health.
Then there's another way to look at it. That all humans that live in modern civilized societies have some level of heart disease. some level of atherosclerosis from the mismatch between our lives, and the way hunter-gatherer's and tribals live. Even children who die in tragic accidents in modern societies have some level of heart disease. No matter how healthy you are, your lifestyle probably isn't nearly as heart-healthy as you think it is considering the environment the human body evolved in. (in comparison to this one)
So whether or not there is clear cut evidence that yolk cholesterol can change human cholesterol, some people err on the side of caution. Also, you can have some whole milk or 1% milk or anything with egg-whites.
Also, a bigger issue is that pasteurized egg white is really convenient and delicious. It's a lot easier to drink 1-2 cup of egg-white with some-thing else, than 4-5 of full-eggs. Throwing some egg-white into a protein shake (vanilla) and mixing that with frozen strawberries and milk, blending that up. It's pretty delicious. A lot of the nutrients in eggs can be found in other places as well.
I do eat eggs and egg yolks, but the majority of the egg I consume is pasteurized egg-white.