I think your opinion is not unpopular, but it is irrelevant to the discussion at hand. In this court case you can have plenty fun at work, but still prefer to do something else when work is over. You spend a huge part of your day with your coworkers, so maybe after work it is perfectly reasonable to want to spend it with other people, such as your family or non-work friends.

The point here is that mandatory fun time isn’t a leisure activity if you are forced to do it, it is overtime work. If your not getting paid overtime to participate, then it is free labor. And you are never obliged to do free labor no matter how much fun you have with your co-workers otherwise.