Hmm... this might be because your feeling is Tertiary rather than inferior. But yeah, I definitely know what you mean there. The bolded is especially true for me... if I can't turn the feeling into an abstraction, I can't identify with it or feel moved by it. Which means I don't end up valuing shared experiences the same way most other people do.
I seem to end up processing concrete reality in a ridiculously impersonal and cold way that strips it of personal meaning. The physical just seems like a cold, dead data mine, in comparison to my meaningful abstractions. My natural approach to processing physical information is roughly analogous to strip mining. It's a fairly destructive, detached process, and focused only on acquiring what's been deemed valuable as an end goal. Doesn't involve feeling anything about the experience.