Has anyone set something like this up with sound + multiple viewers? I've been looking for someone to help me watch TV with friends who are remote. I used to use rabb.it but I think that died.
Have you looked into VLC or OBS for doing this? The big issue that isn't really solved is that most desktop protocols take advantage that the image has a majority of the screen static and only small areas of the screens need updates. Video is the exact opposite problem: nearly every pixel changes across frames and so to have it be reasonably well sync'd especially with sound you need a different kind of protocol.
Rabb.it was really cool because it was a shared web browser that was ephemeral and neutral. Both people could control it, there was very low latency, and you could keep doing sensitive stuff while rabbit was also open. I haven't been able to find a way to do that with RTMP streaming systems.