Dude, presuming you don't have a significant physical handicap, there's no reason for you to even be considering this kind of defeatist mindset.
Go check out the Over-35 Lifter forum and you'll see plenty of guy's making consistent, badass progress while being full-time workers, bosses, husbands, parents, and grandparents.
You want more relatable goals? Find holymacaroni, hungry4more, or Alpha's post history and check their progress. I think they're all out of college and serving in the military while being in genuine beast-mode.
Out of curiosity, what are some of your current best lifts?