I was just saying I do the same thing reaching through the hawse hole. But it's not as handy as his which sounds like it's located right over the locker, and it's much bigger to reach through.
I can understand your situation if it's part of the windlass set up. Steves idea made me think of the dorade box I have on the foredeck. I have a 4" deck plate in that, forward of the cowl vent, over the 4" ventilation hole in the deck. If it wasn't located so far aft, that deck plate could give the same access to the anchor locker. I use it now for my deck wash. A better placed one could serve Steves idea nearly as well.