“A Failure in this Duty did once involve our Nation in all the Horrors of Rebellion and Civil War.”