Even if you dont actually kill the settler/unit, they tend to not like charging at your units and you can really slow them down, even with Scouts.
There's a risk in that, sometimes they will settle a city as soon as you DoW and the city might be planted in an extremely bad spot and you lose a unit due to the city bombard.