It's actually neither bandwidth nor latency (alone). Its variability - the reason you can play a 4k video on YouTube smoothly is because of buffering, which smooths out dips in mbps. Stadia can't buffer for obvious reasons, meaning every frame has to be delivered with minimal latency.