Yep that's similar to my diet except with 2x bananas, no joke. Mine's low carb, although I take a banana before workouts (now workout 6x/week).
I've done experiments on myself several times and the outcome is always the same:
Cut out saturated fat from the diet (keep fat intake the same but no more than 30% of my dietary fat intake was sat.fat)...and without fail I find it very difficult to gain mass, my sex drive plummets, and my intensity in the gym sucks.
Translation = testosterone levels go down.
As soon as saturated fat is increased to at least over 50%, gains come easier, and sex becomes aggressive again (sorry for T.M.I. there lol).
In my opinion the reasons why certain foods are more anabolic than others is because of saturated fat (e.g. beef, milk products...and in smaller amounts, nuts and eggs etc).