IF hes yours, you honestly look at who would be able to provide and support him the best.... you want him to have the best childhood possible, and not to be pulled back and forth between feuding parents.
If there is any doubt hes yours, fuck it, let her raise him.
If youre not ready to give up your lifestyle for the kid, hed be better off with his mother.