It is not worth the while to let our imperfections disturb us always.
 Henry David Thoreau, A Week on the Concord and Merrimack Rivers (1849). copy citation

Context

“Men have a singular desire to be good without being good for anything, because, perchance, they think vaguely that so it will be good for them in the end. The sort of morality which the priests inculcate is a very subtle policy, far finer than the politicians, and the world is very successfully ruled by them as the policemen. It is not worth the while to let our imperfections disturb us always. The conscience really does not, and ought not to monopolize the whole of our lives, any more than the heart or the head. It is as liable to disease as any other part. I have seen some whose consciences, owing undoubtedly to former indulgence, had grown to be as irritable as spoilt children, and at length gave them no peace.” source