He was also so embarrassed when the truth came out about his wild sex life. He had a squeaky clean image and that ruined it which is one reason why you should never try to act holier than thou. All the stuff about Trump just rolls off like water on a duck's back because everyone always knew he was a womanizer and plus he doesn't give a shit. He knows Trump well so he should have taken a page out of his book.
He had a Nike contract as well as a contract with other companies that required the squeaky clean golfer image.