I doubt it had anything to do with that.
Wasn't the lady an old hag?
Phil appears somewhat insecure even today... imagine him back in the day. He settled with nice non-intimidating older lady who he was comfortable with for the time. But he eventually grew out of it.