320 grit is as fine as you need to go unles you are using a urethane like minwax instead of real varnish.