It depends a lot on the context of the situation; sometimes if not right, in can turn what would normally be a dark and insidious remark into a clever piece of humor that invokes good laughter. If done wrong though, it makes for awkward and juvenile tension between persons.
If I sense that it was indeed a joke, I don't mind. But if I sense that the person wasn't joking, then I get pissed, because it's hard to argue with ''I was just kidding''.
A man builds. A parasite asks 'Where is my share?'
A man creates. A parasite says, 'What will the neighbors think?'
A man invents. A parasite says, 'Watch out, or you might tread on the toes of God... '