I have good luck with ranged-only conquest. Bring a horseman along for fun, and then just rotate out ranged units when they're hurt. Constant damage from, say, 6 units can take down a city in 2 turns, rather than 4 turns for 4 ranged and 2 melee.
if it's a very strong city and scouts are still buildable, they're often times very solid cannon fodder and adept at breaking roads and trade routes for cheap. Flood the enemy territory and capture/kill their workers while breaking the trade routes from their capital and/or key strategic resources (What's that Germany, you have 10 panzers ready to go? Say bye-bye to your oil. . .) sets you up for a pretty easy war.
Run a fast unit like a scout or horseman in after the city is at 0 and nab it.
as others have stated, more important than your number of units is your tactics. Plan beforehand what you're going to do, at the very least in the city you're looking to take. Better (and more difficult) is a two-pronged attack on larger empires, one that forces a wedge in between the capital and the smaller (generally more useless) cities, and another that pushes up to the capital city. You can leave the useless cities, or if you're intent on total war, take them out easily after the fact, and they will be unable to support the capital as it comes under fire.
When facing the AI, I ironically find the best option is to find a highly defensible position by their borders, and then just camp there and kill their army as it comes in. Generally the AI will throw their entire defense force at you and once it's gone, you've got a cakewalk. Generally doesn't work with humans.