D'ohhhhhh! My mistake, thanks for clarification. Intuitively, I guess that didn't dawn on me, as the residents would be upset, not the leader. I'm now looking at a city of Ben's right now, who is still upset at me, and noticed his face isn't angry on the city, so I assume their faces don't change based on relationship?
Random aside, but I really like the banners for the fact that I can tell if an enemy settlement is a city or town(plus it's specialization), I never understood why they took the time to make a "palace" vs. a "city hall" but didn't make towns show a "town hall" instead lol.