I think it's very important. I would start concentrating on pull-ups if I were you and do them first in your workouts. You should be able to do more that a "few" pull-ups at this point.
I'm about 210lbs and I can do pull-ups 5x5 w/65 pounds added on. Dips 5x5 w/115 added on.
Obviously, the heavier you get, the harder it is to do pull-ups or dips. If over time after specializing in them for a while you still can't put up respectable numbers at that weight then you are probably too fat. Try to drop your bodyfat % and your lifts will go up in no time.