What I'm surprised about though is that I think most INFJs would fairly instinctively understand this feeling. I hate it when Te users tell me all the reasons why I shouldn't feel upset. I want them to either listen or to agree enough that I'm reassured that I'm not crazy for feeling the way I do.
That's why I wonder if something else is going on. I do think that Fe users feel a lot more detached than Fi users when giving advice (which Fi is less likely to do anyway), even if they feel sympathetic. It sounds though like the issue is a little more than just that though.