Gene makes two very good points, depends on the experience of the crew and on how the boat is set up.

Bigger boats require more physical effort. A lot of this can be overcome with electric or hydraulic winches. The schooner rig breaks up the sail plan which helps but even with powered assistance you will sometimes need a strong crew to move the sails or other equipment on a larger boat. If you and your wife are in good physical condition this may be no problem for you now but also consider how long you will want to sail this boat and if, as you age, you will be able to keep going.