I have never seen a worker change irrigation to mines even though I have heard about it happening. If I saw a worker doing this, I would not use the automate function. Since I have only seen automated workers improving terrain in the same way I would, I almost excluevly use the automate workers (mostly fully automated, about one-third trade-network automated). I have never had any problem with workers.