Not the whole story. Japan says no to almost everyone, all the time. Isolationism and xenophobia are alive and well. As far as they're concerned, you are exactly as undesirable as a muslim. They're not on your side. They don't see anything at all in common with you. You are not Japanese. That's it. How you feel about muslims - that's how they feel about you. Praising their policy is like a black-hating Jew supporting the Klan.
But I agree it's time to close the door on refugees.