"It is a fair summary of history to say that the safeguards of liberty have been forged in controversies involving not very nice people."