The TJs often can't stand it, either.
I am one who is definitely often rankled by Fe.
And hell, even a good number of the TPs are bothered by it (often due to rejection/suppression of the inferior).
For whatever reason, Fe seems to get more hate than any other function, and it's not just from FPs.
I think it has something to do with it making subjective value judgments that it (falsely) considers to be objective.
That act of judging has implications for those being judged, and that mistaking what is actually subjective (and normative) for being objective seems to be rather inherently irksome (Fe, as seen in what I wrote above about Te and Ti, is not the only function to make this objective/subjective mistake, but I think it's this conflation combined
with the judging of others based on that conflation that causes Fe to be so widely held in contempt).