As Renaud said, horsemen are too easy to kill, if they don't show up in the early stage.
One reason is that they don't take rest enough to restore their full strength after combat. So usually,
right after they attacked one of my fortified cities, they are vulerable.
Hope some improvement..:)