Very true.
You end up not using it as much as you thought you would, and upkeep is a bitch.
Growing up, I fished a ton on my friend's father's boat. A 42 foot Bertram.
We used the boat much more than the Dad, who was an avid fisherman. People would say he was crazy for letting us take it out, even though both of us had all of the credentials and safety courses. He said: "I have so much money in that boat, and the equipment (Penn reels, etc.), that somebody better be using it."