I don't know others' takes on this, and I won't even say that I think I know what's best.
My experience, however, is that I was able to do 70+ dips and 35+ pullups before I started adding weight. When I started with weight, I was already able to do a decent amount, so I can conclude that it didn't hurt me too much.
I'm unable to say if I'd have progressed faster if I had started with weight earlier, but it's entirely possible.
Take it for what it's worth...