Lucky you can do that...
You need to change your outlook man.
I do consider myself what you call 'lucky', for various reasons, but I still bust my ass when I have to.
Here's a small tip that worked very well for me last year when I was dieting : Train legs at 3 times per week (more if you can), with a decent amount of volume. I noticed a big difference in metabolism and speedier fat loss.
I don't know you, and I'm not attacking you, but you seem like a guy that just makes excuses, is inconsistent, and doesn't work hard. You said you were a lazy fatass all your life, so maybe you think you're working hard enough, not knowing better since you've never had someone to push you and force you to work truly hard. Have you ever ran till you spew? Trained till you pass out? Just put all the bullshit aside, stick to your diet, train your ass off, repeat, do that for 6 months.
And eat some damn almonds.