Intuitively, the problem is that oxidation becomes more "three dimensional" in a non skid. You are encouraging much deeper deterioration from UV effects than with a smooth surface.
The deteriorated gelcoat is much weaker as a result of the UV degradation.