If the weather is right, the moon is full, etc. it should be a nice overnight. I suggest you leave during the early morning and get to Nofolk during the day. Look a the chart, unless I remember wrong, you can avoid the main ship traffic into the mouth of the Chesapeake Bay.
If it's early in the summer, the Southern Bay should be pretty nice. If you've not visited some the places down there, there's some interesting exploring in the James and the other rivers on the western shore up toward the Potomac. Then (with your 4.5' draft) you might try the culteral shift and Smith Island. It won't be there much longer culterally and physically.
Then you have the mouth of the Potomac and more bucolic places like St. Mary's, then the Patuxant, and up Oxford/Choptank... etc. etc. ;^))))