I understand what you mean. I have genuine sympathy for unfortunate people though, which is likely why I think the whole thing is weird, not because I think their misfortune is funny or should be made a spectacle.
Have you contemplated that on any day an accident can occur that makes us mentally or physically handicapped? If that were to happen, would it be reasonable for people to dislike you because you were retarded, in the same way you dislike retarded people?