If you stay in the channel, I don't think you'll have any issues. Some marginal areas might be affected. HOWEVER, last weekend we noticed a moderate amount of trees, logs, debris. The various river valleys which make-up the Chesapeake and Delaware Bays have seen many inches of rain in heavy levels over the last few days.
I'd be pretty concerned with plowing along a night (when you can't see anything) or during the day without paying attention.
The flotsam that is out there might cause a problem for a prop or hull damage if you were moving along at some speed or against the current.