I agree with the INTJ's who've said you should talk to him and be very direct, asking straight questions like, "Is there a problem between us?" or "Are we still friends?"
We INFP's can tend to be vague or dance around the elephant in the room because we don't want to hurt people, but in my experience with INTJ's, it's best to just lay everything out and be completely blunt. They're not hurt by it. In contrast, they're annoyed when we don't get straight to the point.
Also, this is just my opinion, but I wouldn't call his end of the phone conversation hateful. Rude, sure, but not hateful. If you want to try to patch things up with him, you might need to try to keep in mind that his way of dealing with things will probably be blunt, but don't read it as hateful just because it feels hurtful to you. We INFP's are super sensitive, and sometimes oversensitive, so it helps to try not to read too far into what INTJ's say or do.
Good luck... Hope you guys get it resolved.