On one hand, Desert Flower, you should proceed carefully. ENFPs are, unfortunately, rather flighty creatures that tend to lose interest quickly. We don't mean to hurt other people, it's just the way we are.
Yet on the other hand, the way you describe this fellow - how he gets very uncomfortable and shy around you... is one of the (rare) indicators of him genuinely having feelings for you. Not to say that it's certain he does, but I think if he was to be just there to 'crack you open because he can't help himself', he would approach you more openly and charmingly - like he normally is, and how he charms everyone else. It's only when our feelings are genuinely involved that we tend to get confused and quiet.
So that's what it looks like to me - I would say proceed. With caution, of course, but go ahead. I think the signs look good.