No man of sense need restrict himself, or deny himself a single amusement for his wife’s sake
 William Makepeace Thackeray, The Luck of Barry Lyndon (1844). copy citation

Context

“, ‘and do you know, sir, I heartily regret I didn’t marry her? There’s nothing like having a virtuous drudge at home, sir; depend upon that. It gives a zest to one’s enjoyments in the world, take my word for it. No man of sense need restrict himself, or deny himself a single amusement for his wife’s sake: on the contrary, if he select the animal properly, he will choose such a one as shall be no bar to his pleasure, but a comfort in his hours of annoyance. For instance, I have got the gout: who tends me?” source