Well factories can easily pay themselves of, if you like to build you civilization.
If you are a "power-gaming-comquisidor", i can see that it's not neccesary.
Sometimes i start out with going for the conquest, but I get sympathy for the other nations and let most of them live, and then i must...