You cant help what you are attracted to, its inherent.
Im not attracted to girls with bad teeth, Im not attracted to girls with fat arses of huge droopy tits
If someone is ugly you dont have an interest initially, getting to know someone can influence that, take workplace romances, the person they have the affair with tends to be less attractive than the wife, its just that you are attracted to the personality which can over ride the looks