Thanks for the additional info. It's reassuring. I did have another concern with the caulk because of the mineral spirits. I wondered if it might cause a problem with the plastic hatch (which of course said it should be bedded in silicone - not on my boat thank you!). I would guess the tape is more "inert" that way. I didn't actually realize the caulk had mineral spirits in it until I started using it and could smell it.
At any rate, assuming the hatch plastic survives, I will leave the caulk in there. It's not a locker that would cause a huge problem if it leaked (although if so I would re-do it).
I think I'll order some tape from you soonish.
CCA-Boater