We found that anchoring outside is much less rolly. West of the ferry dock, and along the South shore. There is a shoal that juts out from the South shore,and blocks waves. We also use a stern anchor.
The roll comes from the tide change, and the "V" type bottom. Duck Harbor puts you right on the Acadia trailhead. There's a big eagles nest there as you come off the ferry dock too.