The thing sips fuel, so shutting off the valve and waiting in neutral can take well over 10 minutes. In fact, I wasn't even sure the shut off valve worked until I shut it off and ran it out of fuel by running around for about 5-6 minutes.
I see now that is the easiest way to run the engine dry. Just do several circles near the mothership while staying in rowing distance.