Before I knew the types, these things annoyed me much more.. I just listed the top two genuine annoyances because I think they cover the bulk of it.
Lack of flexibility, go with the flow, lack of ability to change plans without getting whiny about it, even if it is a minor change of plans that doesn't effect much. (Of course, this is more J's than just non SP's.)
Looking too far into things.. ESPECIALLY what is said. This often causes unnecissary drama and a waste of brain power and a waste of breath. I don't mind it when people don't understand what was said, and need to clarify or get a better grasp, but a lot of people take a clear statement, or a statement or something that happened with not enough information, and then draw all these ridiculous conclusions, or "what ifs" instead of using their time wisely to ask appropriate questions to investigate the hard facts. Assuming makes an ass out of you and me.
Expecting you to look into things. Not being clear, trying to communicate through facial expressions, making you read minds.. Again, not that I can't, I just don't see the point.