strengthening your core should, in theory, help. I'm trying that just now to try and fix my own chronically shitty back.
Careful, though. A lot of core exercises can fuck you up if you let your form go to shit so start with the easiest variations you can and build up from there slowly.
And like Uncle Bird said: avoid what hurts. Muy importante.