Fermi's paradox is pretty compelling, mainly because of what can happen with compounding returns (or accelerating progress). Even if humans are the result of fairly many 'lucky' coincidences, such that life could form on Earth much earlier than elsewhere (on average), a mere million year headstart could make a drastic difference when it comes to interstellar colonisation. I don't feel confident predicting humanity's progress for more than a few centuries, but if current trends hold, we should be at least considering interstellar travel by 2300. If the people of 2300 have their 'wishes' fulfilled, then in a million years the galaxy would be in the process of being greened with our life.