With how we use the boat, I've pulled a lot of items off that I would keep on if we were cruising for a few months. I've also been working on the bottom improving the smoothness a bit every year, fairing the rudder, little things. Like you, I'm always looking for better locations for heavy items that I can't take off.
I'm sure these small steps have all added up to better sailing for me as I've seen an improvement especially in light air the last few years. More sailing.