Not even really a mistress. His first wife left him and then he got a girlfriend who he married after the first wife died.

In modern America peoples marriages breaking down and then them getting together with someone else is pretty common.

For someone with his wealth, having only one mistress shows some self-constraint.