I "bumped" a very large sunfish with our cute once just before 40 miles east of Nantucket/Cape Cod. We were ghosting along at about 3 knots in very light air when all of a sudden there was bump, then a bunch of commotion and this very big creature wallowed off. I don't think I hurt it, but who knows.
I've hit tree trunks before with glancing blows, occasionally I've avoided telephone poles, railroad ties, and seen some parts of trees actually floating with only the leaves visible until you get close. So far, like many of us here, it's been only an incident that lead to a little profanity.