Note however, that you can't use diff on binaries, [...]

You absolutely can, but you need to use an external diff tool:

   fossil diff --command "compare"

You can also customise the diff-command variable. You might need to pass --diff-binary .. I forgot.

As for storing binaries, unversioned files have no history, and are not synced automatically.