I am trying to imagine keeping my cool in a situation like the one you describe and I'm not sure that I wouldn't have lost it on the guy and said get the fuck off the ab machine after your set, that's what working in means, you idiot.
On another similar note. It pisses me off big time when someone sits there on a machine resting between sets....but then, I admit patience isn't my strong suit.