It would be cool if town specializations came with a narrative event once you specialized them. This event could provide deeper bonuses or provide that town with a bit of character beyond the categorization you are putting into it. I'd love these narrative events to be used to make little parts of your empire come to life. There is a great Shawnee policy card that does this to a degree (I think it's +culture on farming towns or something).