The wind, the chop and the intense spray would make breathing alone difficult, not to mention any sort of progress. It can be hard to walk in hurricane like conditions, much less swim. Rescue swimmers that DO work in those conditions are in very good physical condition, in wet suits, with buoyancy vests, big fins, mask and snorkel.

Sounds like he was in an impossible no-win situation at that point.