I'm actually surprised that this comes up so much though. Every INFP I've met was really aware of social norms and didn't really do anything that wasn't in line with them. As for ISFPs....wellll....LOL....perhaps they were only talking about ISFPs and not INFPs.
ETA: When reading through this thread I realize that basically we all just drive each other nuts. lol. Heh. Acutally it's not really that often that I have personality based issues with people. Usually people irritate me becuse they're immature or hurtful/inconsiderate or just flat out annoying and it's not really related to personality.