Of course it's wonked. Personally, I was virtually unknown 7 months ago when I voted on the poll. And maybe what you're seeing is not "obvious" false modesty but how different people interpret being "popular".
There have now been two groups formed with my name on them. Of course one is the "Marm Hates Me" recovery group, but notoriety is a form of popularity.
"Sentiment without action is the ruin of the soul." - Edward Abbey
"In those days I, Daniel, was mourning three full weeks. I ate no pleasant food, no meat or wine came into my mouth, nor did I anoint myself at all, till three whole weeks were fulfilled." Daniel 10:2-3
SIDE NOTE: If 5 is actually 'average', then people are generally underestimating themselves. That said, the difference between 0 and 5 is probably a fairly small amount of popularity and between 5 and 10 is a very large amount of popularity.
Its maybe as arrogant to suppose being universally disliked as universally liked, I expect most people dont care either way.
I know there are people dislike me or at least what they imagine me to be from what little you can tell from posts on a forum, in that limited context I'm pretty sure of it. I'm confident about this because there's people here I feel that way about too.