In Guns, Germs, and Steel, they do a good job outlining it out.
The hunters in Africa, started out really unskilled and poor. So, while they were getting better, so were the animals they were hunting (at avoiding humans).
After humans got a lot better, and decided to migrate away to find their own living space.
Meanwhile... (back at North America, Australia, random islands in the Pacific)
The animals there had no previous contact with humans, so they are minding their own buisness, not caring about those silly hairless things running around, as they have no reason to fear them. Then they get speared, skewered, attacked, etc. by skilled them. Dead! Blitzkrieg hunting! Blah!
In otherwords, they have no expierence with human hunters, while humans already became relitivly skilled in hunting, and found them easy pickings for large meals. So, hunting to extinction! They could not adapt fast enough for the human hunters backed with thousands of years of expierence passed down from hunters in Africa, and with more modern tool making. (spears and arrows, rather than sticks and rocks)