Always think hard about whether you really need the units, don't forget that each one is sitting there draining your precious gold, and check the economy overview often! Maintenance is really important in this game, both for buildings and units.
In peace times I keep roughly one military unit...