If you use any of the more direct API sandbox/studio UIs, there are already various sliders, temperature (essentially randomness vs. predictability) being the most common.

The consumer-facing chatbot interfaces just hide all that because they're aiming for a non-technical audience.