But when someone commits a crime, we're not interested in being more parsimonious.

We're interested in achieving justice. Justice which is defined by our democratically determined court system.

Why do you think being parsimonious is a better objective than being just?

If someone is a member of the local golf club, should the golf club be called to met out punishment if the member swindles some pensioners out of their savings?