I personally find that the moment I can just relax and sit back quietly in someone's presence, it means I feel utterly comfortable with them and free to be myself. And that's a special moment to me. So I tend to just sit quietly smiling, or tossing them a glance occasionally and even more fun is just snuggling up with them without saying a word and even while doing something else, watching tv, reading a book, even playing on the pc. Physical touch is incredibly reassuring to me, but even their presence will quiet me and make me content.
You however sound like you feel nervous if you don't entertain him 24/7. Relax..he likes you, otherwise he wouldn't be there. Let him enjoy your presence, you don't have to be on stage constantly