“Everywhere among the English-speaking race criminal justice was rude, and punishments were barbarous but the tendency was to do away with special privileges and legal exemptions.”