Yes, it will go down. But only for turns where nothing happens in the war. No battles obviously, and no units in each other's territory etc.
And if I am not mistaken, war weariness will go down to the point where you are just not getting any unhappiness.