I know I'm in the minority here, but I actually don't have a problem with him taking leave. I agree that he needs to be accessible during a time of crisis, and he ought to have a deputy who can step in and run the department in his absence.
That said, I would not apply a different standard to him just because he is gay. Bonding time with newborns is a crucial time for mothers and fathers (including adoptive parents). He shouldn't be deprived of that opportunity.