I'm pretty sure I get what you're saying, and I've been in that position myself, not wanting to do any cardio as it would make me lose any size I have, but then I realised basically it was just an excuse for being a pussy (I'm sure there are exceptions, as there are with most things, but I'm talking about in my case and that of everyone I can think of who has ever had the same attitude).
I know people way bigger and at the same time, fitter, which blows the theory that you can't be both to pieces. As several people have pointed out, look at athletes (i.e. sprinters, rugby players, hockey, nfl, etc.)
Having said that, there is a right and wrong way to go about it: if you start running long distance regularly, yes you will most likely lose quite a bit of muscle. So keep the majority of your cardio very short and high intensity, keep lifting heavy, eat to support your goals and you'll be fine. Also be creative, don't just use sprints but include a variety of other exercises as well such as pulling and pushing a prowler (if you don't have one I have found a car makes a pretty good substitute), farmers walks, fireman carries with a training partner, heavy weight circuits, sandbag work, etc.
(Final addition, by the sound of it you are not looking to become efficient at one particular sport but to develop more all-around fitness/work capacity/gpp, in which case the sprint-type training will take care of most things but you may feel the need to include a little longer distance training, this is fine but just do it every now and then, rather than regularly enough to negatively affect your physique).
Hope this helps?