The poor man, on the contrary, is ashamed of his poverty. He feels that it either places him out of the sight of mankind, or, that if they take any notice of him, they have, however, scarce any fellow-feeling with the misery and distress which he suffers.
 Adam Smith, The Theory of Moral Sentiments (1759). copy citation

Context

“But vanity is always founded upon the belief of our being the object of attention and approbation.7 The rich man glories in his riches, because he feels that they naturally draw upon him the attention of the world, and that mankind are disposed to go along with him in all those agreeable emotions with which the advantages of his situation so readily inspire him. At the thought of this, his heart seems to swell and dilate itself within him, and he is fonder of his wealth, upon this account, than for all the other advantages it procures him. The poor man, on the contrary, is ashamed of his poverty. He feels that it either places him out of the sight of mankind, or, that if they take any notice of him, they have, however, scarce any fellow-feeling with the misery and distress which he suffers. He is mortified upon both accounts; for though to be overlooked, and to be disapproved of, are things entirely different, yet as obscurity covers us from the day-light of honour and approbation, to feel that we are taken no notice of, necessarily damps the most agreeable hope, and disappoints the most ardent desire, of human nature.” source