"The challenge to our liberties comes frequently not from those who consciously seek to destroy our system of government, but from men of goodwill - good men who allow their proper concerns to blind them to the fact that what they propose to accomplish involves an impairment of liberty."