I could be broken a bit as my brain misses some of the "rules" that others seem to notice without trying. I have to learn them like an autistic person learns social skills.
As for "casual" almost all places are what I make them to be. Everywhere is casual until the mission is compromised at which point my inner Te emerges. Otherwise I am what the person right in front of me needs me to be to establish that rapport.
It could be an ENFJ sees that and feels an air of neferiousness there, given how they interact with others.