It's all about relative proportions. Some physique guys are larger overall than others, but the smaller ones have better symmetry etc. it's always how you look in relation to yourself and how that stacks up to others.
Still, I've also seen guys greet legs just throw on board shorts because they just prefer physique to bodybuilding. A personal choice, albeit one I don't necessarily understand if you've got the entire physique to do well as a bodybuilder.