If your buildings are not getting repaired and becoming condemned you likely need more builders. Try 5% of your population as builders.
I recovered a condemned market and healers house that lead to an entire neighbourhood abandoning within a year by simply upping my builders.