I would agree with improving the later improvements.
It takes quite some time til you get watermills, windmills and workshops,
but I mostly build farms, cottages and mines, because that seems to be more productive to me.
Only exceptions are sawmills on forest areas, because they supply...