Yes, latencies of 10 ms are noticeable for musicians. I feel like I can feel everything over 5-ish.
A fun fact is that that's why a symphony needs a conductor: one corner of the symphony to the other is 17-ish meters, which is 50 ms of latency. They have to lock in to a visual queue because at those distances, you can't synchronize on sound. It's also interesting to note that a symphony very literally sounds different on one side than the other, and not just in relative prominence: at march tempo (120 BPM), if you're sitting on one side of the symphony, some instruments may be a 32nd note ahead of the ones on the other side by the time they reach your ears.
A fun fact is that that's why a symphony needs a conductor: one corner of the symphony to the other is 17-ish meters, which is 50 ms of latency. They have to lock in to a visual queue because at those distances, you can't synchronize on sound. It's also interesting to note that a symphony very literally sounds different on one side than the other, and not just in relative prominence: at march tempo (120 BPM), if you're sitting on one side of the symphony, some instruments may be a 32nd note ahead of the ones on the other side by the time they reach your ears.