Ok, so your goal changes things. Now that I know your goal is hypertrophy it makes things much easier than if your goal was sports performance. I rather suspected as much but I couldn't be sure from your original post.
1) hypertrophy is your goal, so make your lifting your priority and don't worry about the sports. I would do recovery work day after a leg day though, to work out some soreness. I would make it a goal to do something every day of the week with your legs. I don't mean squatting or lifting weights even, but doing work daily like bodyweight squats and lunges and stretches, a jog, or hell even hiking/walking/frisbee golf, working through soreness (light to moderate, not severe), just plain moving around will eventually make your legs recover faster from soreness.
2) your goal is HYPERTROPHY, so eat like you mean it. And pay attention to workout nutrition. These things make a huge, huge difference in soreness, recovery, everything as Chris alluded to with the collegiate athletes.