According to Webster "A person who owns or sails a yacht."
I guess a yachtsman could be someone who owns a yacht but has never been on it as well. There was a line during a dinner scene in the movie 'Batman'. When Bruce Wayne was asked if he ate in the room often his response was, "I don't think I've ever been in this room before".
That says a lot about wealth.