I thought that following retreating raiders would lead them to their camp but alas they just go to a spot and poof out of existence.
Can we have them to retreat to their actual camp so I don’t have to sweep the cavalry for the entire map pointlessly to find it?
They don’t all necessarily come from camps on your map. While destroying a camp should delay you getting any attacks for a while destroying all the camps on your map won’t stop them from continuing to raid you.
Key word, should. Not always, and destroying two camps or more after a raid does not guarantee even a single years delay. Apart from the loot I don’t think raid camps provide much of a challenge anymore.
Despite ambiguous wording, destroying camps doesn’t actually delay raiders. It just prevents any incursions in the next 12 month. So if you do it right after defeating one raid - meaning you won’t get another for 3 or more years anyway - it has precisely 0 delaying effects. If you raid multiple camps in quick succession, each one just resets that 12 month timer rather than extending it by 12 month.
If you keep a careful calendar you could use this to delay raids… But I just raze camps for the security and all that sweet sweet loot.