Genetics will dictate, but yeah it'll be a late departure. If I'm being dickish honest, you'll probably never get rid of it altogether unless you change what you're used to being. Being lean means being small for anyone who isn't juiced or dna elite. Your strength/ bodyweight ratio improves and its fun to look in the mirror but barbell lifts fall and you're gone in clothes that don't cling. Lifters generally dont like that. Big guys freak out and feel like they're disapearing long before they get lean.
I have a bud who isn't going to be called for any underwear photoshoots but dude's strong as an ox. Told me his wife was complaining at him. I advised him to remind her she married a big strong guy because she likes big strong guys. You can move heavy things and rule a brawl. Big and strong works. It's just not in fashion. As long as you're healthy, who cares if Mens Health isn't going to put you on the cover.
I like being lean because I'm vain but it's not like there's no downside. I have no illusions that dude wouldn't just ragdoll me if he took a mind to.
Fwiw, I like low carb and believe protein should be higher while in calorie debt. Even a pound per week is too fast imo but I don't know about losing while at high bodyweight.