I tend to divide my relations with other people into categories of personal relation. How much do they mean to me? Do they have a strong emotional attachment to me or is my relationship with them necessary for an impersonal obligation, i.e. a hobby or career? A stronger emotional attachment just increases my sense of responsibility to the person. Dealing with a person in an impersonal relationship is like playing chess, making strategic moves for desired outcomes.
If you evaluate a person's worth as a human being by their ability to do complex mental work that a certain personality would find simple, then you are evaluating them against a system that just plain doesn't come naturally to them. It doesn't make sense. I'd rather evaluate someone by their character if it were a personal relationship because their ability to deal with any given situation or their sense of morals is far more important to me as sufficient evaluation. Everything that we do is external, based on perception and personal preference, no one is better than anyone else because we only limit ourselves to what we're capable of perceiving or understanding.
This topic is more relevant to me because I was in an argument with my ESFJ mother about our neighbors. She found out our neighbors are low income country people that she finds to be....weird? Somehow she doesn't like living in this neighborhood because of it and I tried convincing her that even though I approve of her moving at any time, I will not approve of her moving for the wrong reason. She was not in the position to place judgment on the people in her neighborhood just because she was incapable of understanding what their lifestyle meant to them. I would let her move if the neighborhood was unsafe or something more impersonal, but she was wanting to move based on a social categorization that was morally wrong and illogical.
I can go and join a club that people don't like, or place myself in a situation, any situation where people could associate my surroundings with my personality or character, but that is so ignorant that I just refuse to be associated with people who will make those types of deductions. For instance, my mother again asked me how I could buy power ranger toys in the afternoon, play with them in the car, then want to go out drinking later that night. Associating those 2 things as not being associated due to a social category is just stupid. Those two interest do not affect each other. The social categories are just....ineffective in my mind. My association with anything in the world does not change me as a person. I change me as a person.