You have never dieted all the way down in your life. You have no ground to speak on.
It's hard to live where I am even at my current level of body fat. I know that sounds like an excuse, but you would have to live in -40 weather in the winter to see what that's like at an ultra-low body fat before you make a judgment on my opinion. Even right now at around midnight it is just over 60 degrees here. Also, even you won't deny that you are stronger at heavier body weights, even when that weight is fat. I would like my abs to pop out though, so I'm thinking of training abs regularly now. I don't really have a desire to be a lot leaner than I am, although maybe a little, but certainly not contest condition year round which you seem to be advocating. I plan to hit a 500 pound deadlift this year and I doubt I would be able to do that at under 160 pounds. So I guess you could say you trade some quantity of life for quality of life. I don't think there is anything unhealthy about that if done in moderation.