I read that it's not supposed to work like that but it still frequently does.
I seem to always kill him even with just a single unit if he withdraws into a city or is simply just hiding within a city. I don't know if that's intentional either since the only intended way to kill him is surround him on all sides.