A big genuine group hug for everyone who's commented, I really appreciate your help sorting this out with me.
My second issue would be my thin skin. I hide my negative emotions like the plague because very few people can understand why I would be so bothered by some things. People still read me though. I come off as brooding when I don't want to be. I think this might be a detractor from my preceived popularity. I really just want to co-exist and "play well with others", but the truth is, the only difference between a Fe-dom and an Fi-dom in this case is that I can wear a mask for a time, and the Fi-doms can't.
The last thing I can think of has been discussed below...
If y'all have any other thoughts, I'd be happy to hear them. I just get tired, because I realize I'm the reason why I'm left out in the cold sometimes, but I also think over time my problems will lessen more as they have over the course of the last 24 years, and I gain better control over Fe and learn how to deal with people better.