In a way the angry worker is a specialist that gives no yield points to the city. It's more efficient to use that food for a specialist that does give such yield points.
If your use of tiles isn't already optimal. If it is, you shouldn't change a thing. And when the angry worker does come, he's not causing any additional negatives, so don't worry about it (except what noted above as advantages and disadvantages).