I was more of a stereotypical INTJ inside and out (think Mr. Darcy) before I reached my adolescent years. The ENFPs I befriended had a tremendous impact on my ideas/personality and I haven't been the same person since.
Two INFJs thought I was an ENFP, the others say I'm an ENTP, ENFJ, INFJ, ENTJ, ISTJ, and INFP. I think I've been pinned down as every single J type except the ISFJ.
It's guaranteed that people will misread each other all the time. When they have the opportunity to know more about you (and MBTI), I'm sure their first impressions will change by then. If not, keep moving forward. Don't let one bad apple rotten your day.