"Perhaps soon we'll need to keep lists of per-site white-listed user agents..."
Been doing this for many years now. It's a short list, small enough to be contained in the local fwd proxy config
# economist.com
http-request set-header user-agent "Mozilla/5.0 (Linux; Android 14) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/127.0.6533.103 Mobile Safari/537.36 Lamarr" if { hdr(host) -m end economist.com }
I don't use curl, wget, browser extensions/add-ons, etc. except in HN examples. I don't have to worry about command line arguments ilke "-A" or "-U". Proxy controls HTTP headers