There's a big difference between dealing with something from a neighbor's property once in a while, trash ending up in my property, guests not following neighborhood rules for parking, etc., and having to deal with it every single day.

Neighborhoods have a lot of societal norms, my house has frequently been referred to as "the rental" even though I've lived here for years and the prior tenants also all had long runs here... even being a rental house in the neighborhood is considered strange here.