You know it may be nothing. I find ESFP's are a bit fleeting in their attentions, but they're not trying to hurt you. I would be paranoid too, myself, but I don't think ESFP's overthink such matters, as it probably just slips their minds. Such matters probably seem a bit trivial to them, but it doesn't mean they think you're trivial.
And whenever I get confused about an ESFP's motivations, this song helps keep things in perspective:
[YOUTUBE="http://www.youtube.com/watch?v=bDbpzjbXUZI"]Ode to an ESFP[/YOUTUBE]