I definitely realize the difference.
I'm not the biggest anime fan myself- but I have friends at home who hate it and make fun of me for pledging the 'anime frat' in my college (not everyone is in love with anime in my frat but it pretty much runs the Anime Club in college)...
Another reason why a lot of people don't like anime is because a lot of them.. let's be honest here.. are perverted cartoons- which when you look at it like that (to be honest- that's at least the impression I got from more than one anime)- it doesn't seem so great.
There is one anime I liked though and that was "Death Note".
I watched the Pokemon anime regularly too when I was 9.