My Apple TV remote controls the speakers via IR, and triggers the TV to turn on and switch inputs via the HDMI. My game consoles also do the latter. The only time I have to dig out the TV remote is when I'm using an old console or need to fiddle with the settings
At the end of the day yes. Especially, with older generations around.
Having a separate remote for volume (separate receiver) and TV is enough of a challenge. Having a 3rd creates all sorts of confusion.