Josh, unless you're aiming for insanely low body fat figures or have any designs to 'don the thong', I'd workout 5 times a week, and eat more of the good stuff and less of the bad stuff. You know what the good stuff are, eat those. You know what the bad stuff are, eat less of those.
Do this for a prolonged period of time and you'll have your results. It takes time, nothing else.