I think you're being fair. I sort of take my notion of responsibility for granted and I don't frequently question it because I'm comfortable with it basically being contingent upon a consistent connection between knowledge, intention and action.
As a general rule, I think that most people are both guilty and victimized for one thing or another. The driver was responsible for leaving his keys on the hood of the car. By no means, does this justify the thief's actions, but in an incident such as this, emotion tends to skew judgment to the point where personal responsibilities aren't always appropriately differentiated. Both victim and perpetrator may shift the blame because they are so focused on their relationship to the whole series of events that - for instance - a burn victim may feel guilty for the death of someone who died in the fire simply on the basis that they survived. A thief may think that an establishment deserves to be stolen from on the basis that the establishment is corrupt. etc.
It's almost like confusion comes hand in hand with attempting to implement your personal sense of justice when you refuse to appeal to a higher authority.