As EC said you need to prioritise. Are you training in the gym to become better at the other sports, or are the sports a nice diversion from the gym, where your main focus is improving your physique?
If it's the former you could probably get away with less time in the gym by concentrating on the "money exercises". Try CT's Part Time Beast program or his recent Renaissance Body Development. These are great programs for getting a lot out of little time in the gym and improving conditioning levels for sports.
Dan John also has some stories on his web site about how athletes he has coached have had great success during the season by just doing simple, but hard, exercises like power snatches, clean and presses, and overhead squats.
If it is the latter then you need to workout a way to fit in the "fun" stuff so that it won't affect your gains in the gym. It may mean alternating between two sports each week rather than doing both each week, to allow for better recovery.