Glass and metal wash it out and save to bury in deep water by breaking up the glass and knocking out both ends of the cans, harder to do with many cans today so those we crush so they won't float.
Food, chuck it overboard, interesting thing about this especially in anchorages it rarely went more than 10' before it was taken by some fish. In some places it was gone before it hit the water. That not taken on the surface rarely lasted long on the bottom before rays or nurse sharks had it cleaned up. At Exuma Park two nurse sharks lived under the dock waiting for the garbage to be dumped.
Plastic and aluminum cleaned and taken to shore side dumpsters
Paper and burnables we would leave in a plastic bag, take to the beach at low tide and leaving the whole mess in the plastic bag set fire to it below the high tide line, the plastic bag would melt around the burning trash to keep it from flying away in the wind and when all was said and done we had less than a small zip loc baggy of stuff left over such as the piece of wrapping that made the trash by mistake that really wasn't burnable and a little gulf ball size plastic ball that had been the bag. When the tide returned the char spot on the beach would wash away.
We've cleaned up trash bags left in the woods this way and the locals who in some cases had left it after their party were usually greatful we had cleanded up the mess.