What sort of charger (and maybe inverter) do you have?

How do your battery switches work -- are you always running the batteries all run together? What's being "isolated" by the isolator?

If your battery charger has only one- battery output vs. two- or three-outputs it might make a difference.