Do muscles grow when you rest that specific muscle or your whole body?

Im doing an ABxABxx routine where A is upper and B is lower. I figure since my lower and upper body each have two days of rest and enough protein and rest (and then the weekends) they will be ready for the next session and more strength gains.