I remember when blue LEDs started appearing in guitar FX pedals just out of novelty,resulting in a pedals becoming harder to use as when the pedal was on the brightness meant visibility of the controls was reduced. On pedals I made I always used fine sandpaper to increase the diffusion of each LED, and the result was significantly better. Early blue LEDs,especially, seemed to have a very narrow projection angle.
They sell LED dimming (and blackout) stickers on Amazon, and those things have been a lifesaver for me. My new USB-C charging block is brighter than the sun and the LED is functionally useless, so it's been masked with the blackout version of the stickers, but my Dyson fan which has a blue power LED (which turns to red when it's on heat mode) and BRIGHT WHITE LED temperature readout in heat mode has gotten the dimming treatment. Nice because you can still see the light, but 80% less bright, so I can sleep at night.
Dedicated stickers are probably the nicest option, but I've just used black electrical tape to completely black out a lot of blue LEDs electronics - especially in the bedroom like you. If you want to see the light, a few pinholes are enough to let some light through.