“The time comes upon every public man when it is best for him to keep his lips closed.”