Well, while that might be a good idea, it could not be a cure-all or anything like it, as personal opinion.
I said when Obama was elected that the fundamental problem was not Obama, but that we had reached a condition where 51% of voters would actually vote for him. That really is the fundamental thing, not the particular person elected.
It seems to me the same with Congress. The fundamental problem is not the individual Representatives per se, but that we have reached a state where in most districts, most voters actually vote for such as Barney Frank et al.
Simply removing the individual Congressman isn't going to change the fact that in the districts in question, the electorate has become such that they actually vote for such cretins. There would be no reason to expect that their replacement would be less cretinous.
It is true that there could be some improvements in process, though, such as ending gerrymandering and returning selection of Senators to state legislatures.