As the difficulty gets higher do the villagers slow down and the raiders get faster? It seems to be taking a long time for my town to grow let alone produce anything, and the raiders appear on the map borders and are at my walls within real time minutes.