I'm playing with 20k and have had the same experience. With your capital tied up, your expansion suffers, leading to attacks. Using another city, even one 4 tiles from your capital takes building a settler and also has some corruption, which means losing some nice wonders.