It's fallacious to presume that — because gender, sex, race, etc. shouldn't impact peoples' opportunities — that we should treat is as though it doesn't impact them.

This is a good article on the concept: https://everydayfeminism.com/2013/09/dont-see-race/

[Edit:] Or this, as a complementary one: https://www.mcsweeneys.net/articles/i-dont-see-race