"Society is not homogeneous, and those who do not deliberately close their eyes have to recognize that men differ greatly from one another from the physical, moral, and intellectual viewpoints."