To live without feeling or exciting sympathy, to be fortunate without adding to the felicity of others, or afflicted without tasting the balm of pity, is a state more gloomy than solitude; it is not retreat but exclusion from mankind. Marriage has many pains, but celibacy has no pleasures.
 Samuel Johnson, The History of Rasselas, Prince of Abissinia (1759). copy citation

Context

“They act as beings under the constant sense of some known inferiority that fills their minds with rancour and their tongues with censure. They are peevish at home and malevolent abroad, and, as the outlaws of human nature, make it their business and their pleasure to disturb that society which debars them from its privileges. To live without feeling or exciting sympathy, to be fortunate without adding to the felicity of others, or afflicted without tasting the balm of pity, is a state more gloomy than solitude; it is not retreat but exclusion from mankind. Marriage has many pains, but celibacy has no pleasures. “ What then is to be done? ” said Rasselas. “ The more we inquire the less we can resolve. Surely he is most likely to please himself that has no other inclination to regard. ” p. 103 CHAPTER XXVII
DISQUISITION UPON GREATNESS.
source