Yes. My friends and I developed this into its own philosophy of masculinity: "throw down" appeal. Throw down is without question what separates the men from the boys.
(Keeping in mind I might have misunderstood you) I think character and integrity is strictly what separates men from the boys. Honor. That is masculinity exemplified. If a guy can't pick me up, I don't see him as less manly in the least. But if I see that he could, it's just one of the all too many triggers that makes me think about sex. (Although I personally don't find huge muscles attractive in the least... just seems strong in an overblown, contrived, and myoptic way. )