Neighbors who play loud rap music (or any rap music for that matter) moving in near you is a sure sign it's time to move!
Actually, by that time it's usually too late to move. Good luck trying to sell your home while telling prospective buyers, "Oh I don't know what's going on over there. I think their son just graduated from medical school. It's usually a very quiet neighborhood!"