When the time comes to upgrade, the most important upgrade you can get is to a 64-bit version of the OS. The only reason not to go with a 64-bit version is for people with peripherals they want to keep using for which no 64-bit driver was ever made.
The CPU power is more than sufficient. Two reasonably quick cores with hyperthreading, just in case. Faster is better, but this is plenty fast - the fastest CPU you could buy for the thing is, per core, not much more than about 18% faster (without overclocking, the 3.9 GHz turbo speeds of a few i7 CPUs vs. the 3.3 GHz of yours directly gives 13/11 => +18.1818... percent, although the bigger L3 cache may also help some). Your new CPU is slightly faster than my new CPU - my first choice was actually the one you got, but budget issues convinced me to drop down to a Pentium G2120 (I don't know why, but the Ivy Bridge Pentiums are 2xxx series, whereas they are 3xxx series for the i3, i5, and i7), which is almost the same thing but only clocked at 3.1GHz and does not have Hyperthreading. (Literally the day after I ordered it the G2130 came out, which is clocked at 3.2GHz and was the exact same price on Newegg - incredibly irritating timing. In fact, they are still the same price, I just checked. Anybody who orders the G2120 instead of the G2130 at the same price is clearly not paying attention to what they are doing.)
If you upgrade to a 64-bit OS, doubling the memory could be helpful although the difference would be small. You didn't say how fast the memory is. The CPU you have supports DDR3-1600 if the motherboard does (and it probably does). It makes a small but potentially noticeable difference (all other things being equal, the 1600 speed has 20% greater throughput than the 1333 speed - but all other things are often not equal).