These two statements are a combination for slow progress. Stick to one program for 12-16 weeks, at least. By hopping from program to program, you're not letting yourself reap the benefits of consistent training.
The guys are right, you're simply being impatient and it sounds like you're overestimating the progress you think you "should" be making. But that leads to my next questions...
Exactly how much weight have you gained in four weeks? How much were you "expecting" to gain?
In four weeks, exactly how much has your strength improved on the five basic Starting Strength lifts?
Make sure you're getting enough protein. Without it, you'll have trouble adding muscle. For example, with any meal that doesn't contain meat, like with all your snacks, try adding in one scoop of a good protein powder. Based on the type of menu you laid out, I'd be surprised if you're getting much more than 100 grams right now.
Other than that, as was said, just be patient and consistent and track your progress with pics and/or once-a-week weigh-ins. And like I said, stick with the plan for another 12 weeks or so, while charting your progress along the way.