probably not going to fix itself and in any kind of sea motion you will suck water and ruin your engines..also NJ will throw you in debtors prison if you pump diesel/water into the water - even a drop in a gallon will be obvious once it hits the sea.
It seems like you need to take all the fuel out and see where the leak is - didn't those "great folks" at Oyster Bay do a pressure test - can't tell if your 5 boat bucks were hundreds or thousands but seems like no excuse not to test the tanks - limp to Georgetown on the Sassafras and have them fix it