Excluding Buildings from Production Automation

I frequently use Production Automation to avoid micromanaging certain cities, however at some point they always seem to go for a building not desirable for me (ex. bandit buildings or brothels). Is there any way to make an exception so that these buildings/units never get built in automated mode?