At last! He gets it.
The touchiest freaks are arguably Fi-doms, so this doesn't support the case for INTP Fe.
I'm going to guess that what makes INTPs concerned/angry in your presence is that they fear/resent being bludgeoned over the head with Te. This isn't a manifestation of Fe. Fe is not the alpha and omega of emotional response. We are a pretty angsty bunch even without the additional burden of a dogmatic individual. (Note that we are even more concerned/angry when we are bludgeoned over the head, or emotionally blackmailed, by Fe, since we are less equipped to deal with it and see it as having even less validity: it does not respond to reason.)
The "negative display" when you end the discussion and state your plan, is related to the above. It is also a manifestation of the anxiety Ps feel about premature closure. (And almost all closure feels premature to us. It's a MASSIVE source of anxiety for me to be rushed into making a decision, and the main reason we are such terrible procrastinators).