Yes brother Wiggs.
I had women come to my place we get home pissed, have sex we sleep...I wake up at 6am barely light outside, and sit silently in bed listeninv to her breath peacefully in her sleep and I can't rest. I want her out of my place so I can sleep properly and eat my 6 egg whites and drink a coffee in my balcony staring at the London eye from afar....and I usually wake them up at 7am and make up an excuse....I have a house viewing as I'm buying a new house or a car or my brother is arriving from Spain today and needs picking up...you name it.
Sometimes if I really like the girl she might stay till 11am.
It's not assholeism, it's just you/us having an introvert moment, it's a common trait amongst long term single men. I can only socialise for limited hours then I need to be alone.