Only use semi-gloss for the last 1-2 coats. Doing all the build up with semi will result in a muddy looking finish.