Arrogance is not the type related only issue. Age, culture, context, etc. contribute to the "arrogance" vibe from somebody.
I think Es tend to be perceived as arrogant quite often. I know a lot of Es in my life so I'll try to use them as example.
My ESFJ mum is extremely humble and social. However, she can appear "arrogant" to certain people who have failed to prove to her that they are competent and efficient enough on numerous occasion. She would naturally give them instructions and micro-manage with a bit "bossy" tone.
My ENFP best friend and other ENFP friends are the friendliest, most helpful and most modest folks, but NOT to everyone. They can be intimidating, bossy and quite arrogant to the newbies and the amateurs. These folks tone down with like-minded peers who are just as quick, witty and open-minded as them. I've witnessed ENFP arrogance, but never towards me. ENFP and INFP have mutual respect. ENFP can casually praise themselves with that wicked smile. I know these folks enough to understand that those are just their DIY doses of esteem boost.
My ESTJ best friend (with almost balanced S-N) is the most well-mannered, thoughtful, caring and humble guy I've ever known. With people who've just known him? Not so much, they don't have the same access to him right away. To certain people, he can be bossy, extremely confident (which can be misinterpreted as "arrogant"), outspoken and he sticks to his gun in an argument because he's always sure he's right.
My ENTP ex was by far the most outwardly arrogant person I've known. However, this guy is just ENTP to a T - curious, outspoken, playful, loud, scatterbrained and argumentative. He learns through interactions and as many angles and aspects of the same subject as possible. He tends to challenge/provoke people and learn about them through their reactions. Similar to my ENFP friends, he would casually praise himself and it takes somebody who really knows him to understand that it is just him boosting his own confidence, and he does have self doubts.
Another good friend of mine is ENTJ, but she's just extremely humble. She's not NTJ at all in the sense of arrogance.
I think Es tend to appear "arrogant" because they are more open about their ideals, beliefs and thoughts, and they have more confidence than most Is, hence more easily perceived so.
INFPs are not immune to arrogance. Yet I can say that most INFP, especially INFP type 4 are not arrogant, though others tend to perceive us as such often. We have lots of troubles but "arrogance" by definition may not be one, or just the disguise of something else.
Most INFPs feel anything BUT superiority or extreme self-importance. INFx e4 talk about higher self-importance quite often because it's something we struggle to feel, even to a moderate extent.
INFx e4 can be assuming and extremely stubborn. But that doesn't mean we hold ourselves higher than everyone else or we think we've got it all. We're just very selective when it comes to whose opinions and knowledge we decide to let in, whose energy we decide to let effect us.
INFx type 4 are fully aware of our defects, we do not whitewash them. We openly admit them, sometimes with passive aggressiveness and covered up anxiety, and that can drive people into believing that we're arrogant sometimes. If INFP appears arrogant, it's most likely their defensive mechanism speaking.
I personally have never had experience with ENFJs.
INFJ, among all NF, gives me the strongest "arrogance" vibe. However, I get along great with all INFJs in my life because I can see through that defensive exterior.
In certain cultures, arrogance is considered one of the most undesirable traits, hence it is far less seen in these culture than in others.