To add to above replies. You normally don't need to worry about defence early on. They will normally start attacking you only when space for settling runs out. If you have no millitary, they will however abuse you a little by making demands of you. Swallow your pride and give them what they want. You will have your revenge later.