Is it not possible to love someone without desiring to have sex with them? (I would hope so, when it comes to parents, siblings, friends, otherwise it means sex must follow love in all instances)
Conversely, is it not possible to love someone AND want to have sex with them?
Thus if you are not physically attracted to someone, you can still love them as a human being and friend, but not want to have sex with them. And if you are physically attracted to someone, maybe you love them, maybe you don't, but in both cases, maybe you still don't want to have sex. Or maybe you do.