It sounds like you have Raging Barbarians turned on. With that turned on, yes they spawn a lot. You should only build units early on and a carpenter, warehouse and hunters cabin. It's where you gain your xp from battling units. You should be able to get some combat 4 militia and archers after upgrading your warriors. Those militia work well when combined with your shortswordsmen when you build them.