Although, if they denounce you, that's sticking around, no?
I think there's merit to the argument that a "white peace" (nobody gains anything) should be accepted if you truly didn't want war. Granted, I think this really only applies if nobody has lost anything. If you've lost some units, had your land pillaged, etc., I could see wanting some compensation. And I'm always sympathetic to the argument that you need to reduce the AI's military strength so they don't do it again (although, realistically, you probably have if it brought them to the table). But if you think you're entitled to take cities as punishment for your declaration of war, that's kind of a warmonger's attitude.