I suppose it's possible. Clomiphene has been used a long time in bodybuilding and personally I never noticed such an effect, but then again I was not holding everything else constant as you are. I was using Clomiphene either as an anti-gyno agent back before anti-aromatases were affordable, or for brief PCT.
I don't recall anyone else ever sharing this impression or finding.
That said, generally people don't hold everything else constant while using Clomid, you might have have succeeded in picking up a real effect which others didn't succeed in picking up, or there could be individual variability.
So far as scientific studies to see if there could be a known mechanism, in an extremely brief search I found only two. One was irrelevant because it was an in vitro study with absolutely absurd concentrations. The second found it at more moderate concentrations to partially block the lipolytic (fat releasing) properties of estradiol, but at higher doses to itself act like estradiol and promote lipolysis.
From the latter, that suggests that in adipose tissue clomiphene is a weak estrogen, so that could, theoretically speaking, suggest an estrogen-like activity in promoting fat storage.
That said, again this is not something that's generally noticed with clomiphene, but what others experience is pretty irrelevant to your results. I'd try dropping it and see what happens.