We have to blame that on the media. The far sides get all the attention for their extreme views and counterviews.
Plus when a party is in power the crazies who helped get them elected rise to the top. Examples: far left with Obama and far right with Trump.