Thats easy I can give you one name that covers both catagories ,,,LEE PREIST , So many love him So many hate him Thats why he is the most popular body builder on the planet !!!
I don't think lee priest is hated, don't think many hate on Lee.
DO you think a better word would be detractors