It's not quite a busy indicator, its a "already moved" (per turn) indicator. You get a yellow ball for partially moved and a red for move completed. It doesn't matter whether it has standind orders (i.e. for a worker) or it's executing a "go-to"