Some people think you're a troll or lying. I don't because I had the same problem when I first started.
When I first started I was 170lbs with 16 inch calves (I'm 6'5) and 25 inch quads, 13 inch arms to. Also had 42 inch hips (around butt).
Now I'm 265lbs with 17.5 inch calves and 18 inch arms, quads are now 27 inches hips are 43.
Just keep plugging away at your upper body. I worked out my legs once every two weeks, if that. Some people are gonna say, well why? Well, I looked retarded and my upper body needed to catch up.
The only thing I for leg workouts were heavy squats and low volume. I'd generally work up my max triple. My legs are still fairly strong (have squatted 525). I still dead lifted regularly.
Just keep trying to get stronger on all your upper body lifts. Eat well and be consistent.