tkae, is it because you don't like the way the situation makes you feel? I can understand that. With a developed Fi do you think to yourself, "this doesn't feel good to me, I am going to leave the room now" ?
It's more of, "This feels so bad I don't want to deal with it."
Like, it's not so much a conscious decision to remove myself as it is a strong feeling towards aversion of the situation. So if I associate the situation with a person, then I end up avoiding the person. But that's only if it's a person I don't dislike. 9/10 people I'll either like or tolerate, and it's really hard to get me to actually dislike a person in general. So I'd rather avoid them and the uncomfortable situation they cause than actually deal with the problem, since dealing with the problem is conflict (and to know an INFP is to know that non-value conflicts are major sources of distress). But that said:
Personally, I think it's more like "This isn't worth my time/effort"
I can get to that point. Me and my ex are still friends, but after we broke up I noticed he was treating me pretty bad and taking his problems out on me. Finally I reached a point where I just wrote him off and ignored him for three weeks, because I honestly didn't have time in my life to deal with the constant emotional turbulence that trying to avoid didn't seem to solve. It was like if I dodged one of his emotional attacks, he'd save it up until the next time we talked. So that was the point where I finally did reach my limit.
But he figured it out and apologized, and now he knows that I'll still be his friend so long as he treats me like one.
But other people that I legitimately hate (there are a few that have gotten to that point through consistent antagonism towards me and people in general, so basically sources of constant conflict), but even then it's more of an aversion than a cold shoulder (I'm definitely cold towards them though).
The difference between people I'm tired of dealing with and people who have gotten on my blacklist are that people on my blacklist I'll challenge instead of removing myself from the situation.
If a friend is a racist but I think there's hope for them, I'll tend to avoid racial topics and maybe stop being around them.
If someone I hate is openly racist, I'll charge head-first into a conflict challenging their racism.
It's... complicated