If your cities are on hills and he has to attack across a river, you don't need much of an army at all. "Oligarchy" is really strong. A couple of archers, a spearman, and a scout could be enough to hold off waves of swords, spears, composite bows, and a catapult or two. If the city has walls...