Part of the problem is that encoding is treated as something that must be explicitly handled in the string API, but it's something that's just assumed by default in the IO API. Python just guesses what the encoding is, and it often guesses wrong.

The design of the API leads people to do the wrong thing. Encoding should be a required argument for `open` in text mode.