John,
have you thought about using Lock-Bolt Fasteners? It's how I fastened all hardware to our mast & boom. I used them when I was working in the aviation side of my working. You can take a look at them at: http://www.tpub.com/content/aviation/14018/css/14018_62.htm
You can find them at a number of places and are easy to install.
Greg