I was cleared my a military psychiatrist. He is only a general practice. My dreams may make me jump but I don't wake up sweating or keep a knife under my pillow and shit. Not like you see in the movies. I had 2 concussions before deployment playing rugby so its not like physical injuries automatically dictate I have mental health issues.
Sure there is evidence to suggest that REPEATED head injuries over time MAY lead to mental health issues but again, I was cleared after 3 months of intense sessions. I think he just refuses to believe that not every soldier that comes back has issues.
if anything maybe I'm sociopathic since I'm pretty cold to the fact of what I had to do as part of my duty. I don't feel shit but recoil when killing one of those mother fuckers shooting at me and my brothers. 
Didn't a military psychiatrist go on a shooting?
I have a friend who is a Marine, and back when he came home in the 90s, he said that he was looking at ways to escape in malls, looking at the trees, and how he could climb the escalators. I think that is just natural.
Things are not always what they they seem. You could be telling us one thing, but if we were face to face, we may see something else.
Every heard of a man being called the "nicest guy" and come to find out he's beating the ish out his woman, but then people started realizing that they all saw cues..similar. Your doctor may have seen signs in just talking to you, subtle cues. So don't feel offended, feel thankful that he is concerned. Would you want a doc that was like "naaaah, you are ok...", when there might be a little bit of concern?
I do hope that everything is ok for you.