and taking the water taxi across the harbor. It's a great marina (or at least it was in 2002-2005), and it's got the best view of the skyline. If you go there, and Pat is still the manager, please tell her I said "Hi," and ask her about the raccoon with the florescent green butts. There's also a subway station pretty close. You'd have to take a taxi for groceries, though.
Not sure about anchoring out. You can anchor in Winthrop Harbor, but I'm not sure where you could get ashore. There's no anchoring that I know of in the Inner Harbor itself.