Yes, but the point is that it breaks when you have different stuff between your LEGO. Classifiers that can handle anomalies are a lot more difficult to train.

Most DL-based classification libraries skip over this fact.