So what, take the right of speech away from everybody? If the majority can't decide how the public feels about a person or company, and the minority can't decide how the public feels about a person or company, than who does?
The obvious response is to not take the right of speech from anybody, regardless of how democratically the decision to do so is arrived at.
More broadly, just because some power can be exercised by somebody, doesn't mean that it has to be exercised by anybody. To the extent that it may be necessary for a functioning society, it's generally best to decentralize power to the extent possible - think council democracy and similar arrangements, where decisions are made at the lowest applicable levels, and delegation of power flows upwards, not downwards. Some real-world approximations of these can be seen with the Zapatistas, and more recently in Rojava. In both cases, there are local governments that can democratically ban certain things as you've described - but, being local, their power is inherently limited in scope. Thus, it's tyranny of the local majority, and dissenters are free to move away and organize their own communities that do not implement such bans (but still federate with others that do).
