You'll stumble on it often reading about the historic waterways culture on the coast of Maine. Very interesting stuff for me. It's not unlike the irritation that exists for some locals towards people from "away" or the now bygone rusticators, the first tourists. This has old roots.
The water was first a place to work before the first recreational users came along as "yachties". And of course there are bad examples on both sides that give us all a bad name.
I've never had any problems either and know many fisherman but we're out there for different reasons which don't overlap much(like rafting up for a beer )