I'm cruising along with you on my ipad and looking at the anchorage info on Active Captain. The first thing I notice is a review or two saying there is little room to anchor around the island due to private moorings. We found space there years ago a couple times, no problem(just off the inlet). BUT, there were many restrictions getting onshore. According to AC that doesn't doesn't seem to be a problem anymore. That's good, derelict boats encircled Peanut Island back then and were spoiling it for everybody. We still had a great time though and were welcome at the Sailfish marina to tie our dinghy(and we ate dinner there a few times).
The next anchorage to the south of Peanut Island has lots of favorable reviews. Only complaint I see is distance to facilities. As I recall back when we were there(late 80s and early 90s), there were NO ANCHORING signs plastered all over that area. Now it sounds like a big welcome anchorage. Nice!
It looks like things have changed for the better in this area.