If you think you're disconnecting a battery with the switch. then cross connecting?
If you did have an inverter/charger (which is really the most convenient and cost effective way to have a large capacity charger, in my opinion), then if you try to charge without a battery (at least some) of the units will have a blown board. Your switch might become an issue.