You have to change your identity... try to forget the part of your self that needs to look a certain way
Then, like others have said, get in the gym a couple of times a week. If you can forget yourself, you may find a new perspective which will allow you to continue enjoying your workouts.
After years and years of butting my head against a wall and racking up injuries, I found myself incapable of continuing. I could no longer muster the desire to overcome the ever-increasing pain and disappointment I felt. I've tried to shift my focus to cycling and abandon my self-conception as a "person who lifts weights". Lifting is now secondary, and -- so far so good.
Focus on your kids, job, whatever you can -- this might allow you to change what you expect from the gym, and become happy with less. That's the best advice I can give, anyway.