In Civilization V, the horses are limited. When you see the horses at the map, with the mouse over them, there is a number (usually 2 to 6, the maximum of units you can train with this resource). The same happens with all estrategic resources, like iron, coal, alumminium, uranium...