I generally use this approach also
A little fruit (about 100 scale weight grams...20 grams or less total carbs) of high fiber fruits consumed with other foods (protein and fat) hasn't negatively affected my fat loss efforts and I'm not very carb tolerant.
I've leaned out both ways...with fruit and without..as long as you tactically time your fruit intake (around workouts) and keep the portion size small, I don't believe fruit can halt fat loss.
If you're eating fairly large amounts multiple times per day (with some of those being on an empty stomach, this could be debated too), then yes, it could slow down your rate of fat loss. However, there are many more factors that play a role in body fat loss, obviously.
Besides, it offers a wide variety of vitamins, minerals, fiber, etc. That's a fair trade off if you ask me.
It also helps when craving something sweet
I'm leaning out currently, and I usually have 100 scale grams of strawberries and blackberries almost every morning for breakfast. A nice sweet taste first thing in the morning, can (at least for me) minimize a cravings for sweets later in the day.