I can honestly say now, without feeling delusional or conceited, that I think I am reasonably attractive physically and that I have some attractive personality traits. Maybe some aspects are still an "acquired taste" or not everyone's cup of tea, but I don't think I am ugly, no.
Growing up, I was an ugly duckling, namely from age 7-12 or so. I had big, giant Daria glasses, very crooked teeth, and an oblivious to my appearance. People would comment to my sister and me that she was the "pretty one" and I was the "smart one". They often had never really spoken to me, but you know, homely people with glasses MUST be smart. Interestingly, my ESFP sister developed a bit of a complex from everyone assuming that she wasn't the smart one (and so the "dumb blonde" persona emerged...); funny how that goes... Anyhow, in time I "blossomed" and started getting different responses from people. Part of it was that I am very aware of aesthetics & pretty good at making things pleasing to the eye, and once I transferred this awareness & talent onto myself, then I made the best of my looks.
I also had a hard time making friends growing up, especially in my teen years; and so my sister's favorite dig at me in a fight was, "Your personality is so ugly - no wonder no one likes you". She knew it hit a sore spot. But now I know she was pushing my buttons and that it's not really true. I had a hard time making friends because I am shy & pushed people away, not because I am "ugly inside".