Being polite isn’t always ideal. Sometimes, turning down an invite or a gift is the nicest thing you can do – for yourself