You do not hurt large banks by withdrawing your own (small) accounts. Really. On the contrary, you’re doing them a huge favor, and making them more efficient and more profitable.
More details at Why Bank Transfer Day actually helped banks.
This is consistent with what I learned in the 18 years I was employed by large banks.