Plus Ultra
Conquistador
So, for unique district civs conquest becomes a pain![]()

The biggest issue here is that, in order to place your own district, you need to destroy the existing one along with its buildings. Since you shouldn't be, in any way, forced to do so, it becomes an interesting strategic choice rather than a problem.
Certainly not a perfect system, but better than any other aternative.