I think the number of boats surviing, salvaged (and sailed again) is much more likely than anyone colliding with them inadvertantly.
Beyond that, believe that learning of the boats that (for example) arrived in Haiwai after their crews left them is a useful reminder: Usually the boat is tougher than the sailors who are on them.