Well, perhaps they can be replaced it would make sense, and I don't like the limit of three buildings per district myself. But in my mod, districts don't appear until a bit later, as far as turns go.
I think the problem for me at least is the difference between cultural and theater districts.