I have a bad habit of saving before I attack ANYTHING and if the attack fails, I automatically reload. While waging war, I save right when my stack reaches enemy city, then I reload as long as I get the best results.
I have random seed off, so I won't take advantage of that, but I keep on messing around with unit attack orders, until I get the best result.
Can this be considered cheating? If yes, I won't do it anymore.
When I played Civ3, I used to reload every time I lost an Army unit, and every time I popped a good hut for something other than a tech. Obviously I spent tons and tons of time waiting for it to reload, and I completely sucked at the game.

When I switched to Civ4, I dropped that habit - and have since moved up three difficulty levels. To use a bad boxing metaphor, you have to learn to roll with the punches, or else you'll never learn how to fight. It's your game, you can do what you want - but if you want to get good, I'd advise you to learn to deal with minor losses.
Anyway, yes, I generally still do save it before I declare war, and at other crucial points. But I don't reload except under one of two circumstances:
1. I'm testing something, and I want to go back. (Large civics changes, how bad WW is if I declare now rather than later, DoW on trade route income, and so on) Generally I won't play it out and see what happens, I'll just reload after I can see what effect it has.
2. I
accidentally do something that has a major effect on my campaign/game. Like, if I accidentally give all Swordsmen set aside for attacking cities the Woodsman promotion.

(It's happened before) Or I accidentally move all my defenders out of a city, which is vunlerable to attack the next turn. I don't reload if I
fail at something - if the AI is smart enough to destroy my stack, then more power to them - but only if something bad happens as the result of a misclick or something of the sort, not an error in judgment. I suppose some people might see even this as 'cheating' (Maybe call it transcription errors in military orders; plenty of those have happened in history

) but it's my game, and I have no problem doing this. I'm playing to have fun, and yes, to get better at it - but not to penalize myself for ever misclick or accidental button press in a 10-15 hour game.
Note that I'm not talking about adding or reloading things for experimental purposes. If you want to create a game solely to test how good or bad Horse Archers are at taking cities, or what's the highest defense you can get, or whatever, then fine. I think experimentation is different from cheating so that you can win a game that you otherwise couldn't, through skill alone.
EDIT: And yes, I admit to occasionally going into WB to give myself a couple dozen Modern Armor to raze Tokugawa or Montezuma's empire to the ground. But - and here's how I rationalize it

- I never continue the game afterwards. As I see it, once you "break the rules" by giving yourself a bunch of MA's or deleting an enemy stack, you've effectively thrown the game. So while you can derive some useful knowledge from the rest of the game (Or demented pleasure in burning Tokugawa's stupid city with it's Garrison 3 Longbown to the ground along with the rest of his frigging miserable empire....) I don't think you can fairly claim to have "won" the game. Because you didn't, really. You broke the rules in order to make up for your own inability to solve a situation. And you can do that, that's fine - just don't pretend that you didn't.