I only wear a belt on the last set of my main movement for the workout, and only for squats, deads, overhead presses, and rows.
Secondary movements I dont use a belt.
And I follow percentage based loading for my main movements, so the weights that I don't use a belt for consistently go up.