So what's the solution? More affirmative action? Make it taboo to offer a stranger help if they look lost? Make it taboo to make any sort of assumptions about anyone?
Teaching about the common racist stereotypes[0] would help. Perhaps communicating that not assuming minorities belong in specific places can be demeaning, and it's best to be mindful of stereotypes when talking to minorities.