"No man can lead a public career really worth leading, no man can act with rugged independence in serious crises, nor strike at great abuses, nor afford to make powerful and unscrupulous foes, if he is himself vulnerable in his private character."