There is a counterlogic for that: For joining 1 national worker to a city you can join 2 nonnational workers to your city, thus gaining about twice the economic output.
If you add in slaves to a city, then the citizens added in have a different nationality than your own. This makes your cities which are not your capital vulnerable to a flip, if that tribe of the slave's nationality still exists.