When filling an army, do so in a city. While still in the city, IF you have the patch, you can remove units. Once you leave the city, however, it's set in stone.
One nice thing I've found out is that units within an army CAN gain experience. I had several veteran modern armor and mech infantry become elite when I got into a _massive_ war. They kept dying off, however. *sigh*