He was making sure you were ok with it because he knows that if you weren't, he would be in serious trouble. Becuase you agreed to be ok with it, this puts him in the clear - you have given him permission, consent. You are the deciding factor here - it's not very widely known, but some rapists try to establish normalcy within an abnormal situation, while saying things like, 'I would never do anything to hurt you', you nod and agree, but then they go ahead and do the opposite - him not being consistent with his words is a sure sign that he is exploiting your good intentions.
He might blame you for 'misrepresenting' yourself or lying about the fact that you were ok with it in the begining, but it is totally your right to say no, I don't want to do this with you, it makes me uncomfortable. And don't feel ashamed or guilty for saying yes in the first place - you did it out of feelings of duty and obligation - meanwhile, his motivations were probably not so honourable. ...My two cents, and all the best.