Not for everybody, but you can still do it, you'll get a lot of excercise(rowing is great to keep back problems at bay) and you'll not anchor somewhere that leaves you miles from where you want to land.
]We went through the Exumas and there did buy a little weedwhacker engine from a cruiser. We didn't use it all that much but it was handy to get to town when we were anchored on Stocking Island. It died soon after and we haven't had a dinghy engine since.
The second time we sailed to the Bahamas, we rowed again, we took a 2 and 3 year old. We didn't go as far south(just the Abacos) but rowing worked fine. Diapers were a much bigger problem.
If I went for a third time, I'd have no reservations taking our present hard dinghy, and sailing rig, and just a very small outboard(we'd use it very little). It's a far better rowing boat than the one we took to the Bahamas. It's a good safe boat.
It's all what you're used to. I saw the Pardys row into Camden Harbor a few years back.
The first time we went, we didn't have an inflatable and outboard, we didn't have a dodger, we didn't have a lot of the "stuff" many are told they need. We had a 28' boat and decided to go anyway, without a few things. We had a ball rowing!