Or,,, as you said, take the boat to Cane Garden and have them take a taxi to Cane Garden. A bit of a trip from the ferry stop.

Since you're probably going to Cane Garden Bay you might try to drop anchor if there is still a spot or two. The last time I was there you could drip the hook off Stanleys Welcome Bar outside the roped area, inside the moorings and swim to shore although they might have put more moorings in and the spot could be gone.

I always liked going across to Jost anchoring inside the reef at White Bay after a night at Cane Garden Bay. There still may be an honor bar there.