Well it really depends on your appetite and your target macros for each day. I also fast and do carb and calorie cycling even now that I'm bulking because I have a huge appetite. Carbs don't take that long to digest, if you are too full to workout try eating a bit earlier and eat more concentrated carbs. EG: most to least filling from left to right. (Carbs to Volume ratio) potatoes-sweet potatoes-rice-pasta-bread.... see what I mean?
Some people actually recommend eating more on rest days and less on training days because they claim most of your recovery will take place the day after training. I see how this can work. In the end meal timing is nowhere near as important as total caloric and macronutrient intake. So don't over think it. Eat more concentrated carb sources and spread your meals more intelligently. Have a smaller lunch, workout and then have a big dinner. Eat some ice cream or drink some fruit juice to reach your carbs, I don't know.
I still wouldn't recommend eating less on training days. Training without feeling nourished is a huge psychological setback at least for me. I just feel like I have more energy after I have chowed down a big bowl of carbs.
Are you cutting or bulking?