I think you are right. An even better counter example imho would be darts :)
Although... fine motion control is more natural for hands then for legs. In football, running on full speed, while keeping the ball close to the foot, then evading defenders (still on full speed), making an accurate pass to a team player. Almost any boy on the planet dreams about those skills, some are able learn a few of these skills somewhat. But it requires abnormal leg control.
In football there is a harsh filter of it not only being the global #1 sport, so insanely competitive, but also because it requires an insane fine control where we normally don't have that.
Does not take away from other sports like tennis, or base ball. For most sports the elite level will be unreachable for most humans.
i love both sports, but wouldn't call the players universally "athletic"