It surely can't be a problem if you uninstall it - it seems common practice in companies to change which computer software runs on, when they only have a limited number of licences.
And don't most games require the CD to play, anyway? So it's not like you could even play it anyway. Is there a reason why you're asking? I mean, even if you want to abide by the law, there comes a point where you have to ask what's ethical, rather than "technically illegal" - in the UK, it's still technically illegal to copy your CD to you own computer or mp3 player, but that wouldn't stop most people. No one cares about lending a CD to someone else, either. Which actually is an interesting analogy: the idea that you would need multiple licences because you had a song copied on multiple media, possibly for use by multiple people, seems unreasonable, yet we seem to have accepted it as normal for software. Imagine if a CD you bought was DRMed to prevent this, like Windows is?
The EULA is only relevant if what you're doing is by default illegal (in which case, the licence might grant you permission). But if it's legal, companies don't get to decide the law.
ETA: Okay, I see your later comments about not wanting to commit "theft". Well, firstly if you're asking out of reasons of religious morality, shouldn't the issue be what your religion says, not what a country decides? (I mean, I think it's ludicrous to say that copyright infringement is theft anyway, but ask yourself: is your friend committing theft when you lend him something, and he later gives it back? Would it be theft if you lent him your bike or car?)
Also note that the commandments were written in times that, whilst there were harsh laws against theft, this was centuries before any country implemented any laws on copyright. So the idea that biblical law prohibits copying seems on rather flawed grounds to me.