I start every game by going Animal Husbandry > Archery and make sure I build a couple of Slingers to upgrade the second Archery pops. I don't get a Builder until after the third Archer, unless I'm done with the second Archer and still no rivals have shown up yet. Getting caught flat footed will, as you noted, kill you very quickly.