Exactly. I do try to eat "healthier", opting for foods that aren't absolutely loaded with the wrong fats or just completely disproportionate (it's gotta have SOME protein) and I've been losing a ton of fat as well. It's much easier to live happier and eat what you'd like. If you stop stressing over your diet, that alone is going to let your body lose fat while retaining or gaining muscle.
I don't go too nuts, but I'll eat pizza, burgers, chips, ice cream, anything I want. I try to keep my insulin sensitivity optimal and when I do, it makes a huge difference. Put away the dry, baked chicken breasts, egg whites and god awful brown rice.