Actually I knew an esfp for a really long time and although not shy, I don't think they are all that direct. They will show interest but seem to have trouble closing the deal with strong definite interest or taking final action like asking for the phone number, especially with girls within his social circle who are friends, he would crush on the girls but not tell them, but he was definitely open to something with them.
In all honesty, the esfp I knew had low standards in women, pretty much open for whatever, big, small, thin, thick, tall, short, whatever he was probably down if he felt even just a little attraction. If you talked to him for hours, then I would think you definitely have a chance, if you are a friend in his social circle, he may be trying not to be too direct and kind of let things happen naturally, but it's really just being a wuss so go ahead and make his silly day.
Oh yea, strange thing too, after maturing into a full grown adult, he started actively searching for a wife. Like literally saying he wants to get married and stuff, I thought it was strange(for such a party animal), but I think it had to do with the fact a lot of people in our social group were getting married, and he just wanted what everyone else had as usual.