With the mast up you principally increase the risk of the boat falling off its jackstands in high wind areas.

Impact on the rigging from the wind isnt really a problem (for very long term) as fatigue principally propagates when the rig/metal tensions cyclically go over 30% of ultimate tension values .... if the rig is (normally) set at 15%, then that extra 15% to exceed the 'fatigue' value **from the wind** would certainly be well beyond what it would take to knock a boat over with the spars still up.

Get AWAY from this gloom and doomsayer.