I think I relate to other ISTJs, ISTPs, and ESTJs rather well.
I can also relate somewhat to ISFJs and INTJs too, although they often do have personality feats I slightly resent (but knowing that helps me ignore that resent). Funnily enough, I feel it's the two sides of the coin. The other doesn't stand behind what he believes, while the other doesn't give room enough for other beliefs.
I don't think I can relate to people via interests that well. I like watching football, but I dislike football fans.