Losing horse

I have 2 stables full 10 horses but for some reasons, my horses keep losing (I built fence to keep them in the warm season). Does anyone have the same issue?