I'm thinking you won't mind as much (lifting it) after you price the CF boom. I agree though that the mast is more important. My CF mast weighs less than the steel fittings and shrouds. (And my AL boom weighs a too much, also). The compromise is about money. Mine is designed as a fast cruising tri, so I wouldn't want to try to make it into a racer. That wouldn't make sense.

Yours is designed much lighter as a sport boat and any performance changes you do to save weight will be much more noticeable and worthwhile.