I'm using the term "visual" very loosely here. I prefer to be able to conceptually group and link things logically. He was able to explain things in a context that matched this, and greatly simplified things. Some things that I still suck at learning are foreign languages. Sometimes there are rules you can follow, sometimes you just have to "know", and sometimes the rules that apply in one case are the opposite in another. I'm amazed anyone can communicate effectively at all :-)
Sounds like your friend is an amazing tutor. Communication and teaching is indeed hard.
I really believe most people don't learn math because they don't get the teaching they need, not because math is somehow cognitively inaccessible for them (except in case of low iq). Lots of people learn language and grammar and are able to write strong texts with a high level of rational and logical thinking, but have not been able to learn math. These people clearly have the mental faculties for math, they just didn't get the teaching they needed. Math is a language for expressing thought, just like any language is, and these people have mastered other languages, so they have the prerequisites for being able to learn the language of math. Math is an especially hard language and it requires good teaching.
