> NNs are as close to continuous as we can get with discrete computing.

This is incorrect. For example, fuzzy logic[0] can model analog ("continuous") truth beyond discrete digital representations, such as 1/0, true/false, etc.

0 - https://en.wikipedia.org/wiki/Fuzzy_logic