The problem is that the people who benefit from the situation are never interested in identifying and fixing the "bad situations" until things like this happen. They're fine accepting a system that privileges their own children at the expense of others, and only when their children might be affected do they become ostensible advocates for looking at the situation holistically.
Most people support things that aid themself or their family. I don't think that has anything to do with racism. Supporting more objective standards like grades and test results are the only fair way to determine who goes into the gifted classes. Determining gifted class placement by race is racist.
Helping people in a bad situation is a different issue and should be treated as such. Even if there were no poor people, uneducated parents, single parent homes, etc we still don't know that blacks and Hispanics would make it into gifted classes at a higher rate then they are now. Whites and Asians also have those issues and they would likely do better if they didn't have to deal with them.