That's actually a VERY cool idea. If you had a traumatic invasion early on, you become more protective... if you've been betrayed a lot, less trusting...
You could even make it trait related, like you become aggressive if you had some early conquests, financial with early trade, expansive...