I worry about it if we drifted back onto a rock or shallows.
You also need to consider the implications if you did end up aground and get extracted.
Having said that, the reason that the rudder is down there is to provide control surfaces.
http://jboats.com/j160-tech-specs#. Ours is the shoal draft model.