The qoutient between volume and surface area grows as 1/r, i.e. inversely proportional to the radius. Since females are on average smaller, they will have on average a larger surface area compared to their volume. Hence, they are more exposed/affected to external temperatures thus they will generally feel colder.
HTH.