Select the nearest workers

Whenever construction or land clearing is needed, for some reason, the computer always selects workers located near the town center. Even if the construction site is around a second town, it ends up using nearly a month of travel time to reach the destination.