Once Villagers = miners/far away villagers are hungry and looking for food they ignore the nearest Temporary Shelter where the food is stored and going for food to just next Temporary Shelter. Or even to the nearest Market…
As well in case of cold weather, miner (far workers/villagers) looking for some shelter they utilize the nearest shelter but the rest of miners passing the very next empty Temporary Shelter and are going to village to get home.
EDIT: the market in the middle was billed after this ‘issue occurred’