Yes, you can contort your definition of intelligence to be one where you have to be able to overcome whatever personal struggles one might have.
But you wouldn't be actually measuring intelligence. And creating an environment that allows for more people to thrive isn't catering to the stupid either.
Not sure what you are arguing, you didn't seem to read my post? I never said we shouldn't try to make more people succeed, or that everyone who fails are stupid.