I don't have any answers, but reading this made me hungry!
Really though, it depends if eating it gets in the way of your progress. If you are trying to get extremely lean or something, you may have to be more strict.
If you aren't, or you aren't putting on fat, then do what you want (within reason) as long as it doesn't hamper your goals.
Don't let nutrition dogma interfere with your enjoyment of meals if your meals don't interfere with your goals.