Caddy v2 does this! If an ACME error is encountered, it will continue to retry via the staging endpoint instead until it works.

This won't help if you're throwing away the data storage directory though (i.e. not persisting the volume with Docker), because Caddy won't have a way to keep track of what happened in past runs.