Depens on what you think about when you think about colonialism.

If you're thinking about the period when Africa was ruled by European power, I'd say it didnt help (mostly because of the deeply authoritarian aspect of that rule) but there wasnt much to destroy at that point.

Then there is the period Right before which has some deeper effect on trust, corruption, institutions, stability, trade, population movements: the transatlantic slave trade.

Edit: and the eastern one too.