There is a lot of work in this area, especially in the last 50-60 years. I can sum up my thoughts but you are asking for arguments; so i recommend looking toward the literature. It is not a simple answer. I would begin with Rawls, Dworkin, Cohen, Nagel, Scanlon...etc
I'll sum it up: whole lotta bullshit.