I love concerts, but hate crowds. Sure, it's annoying to be in a huge group of people you don't know, most of whom are drunk extraverted Ss. Just make sure for your first concert that a) it's a band that you're really, really into, and b) that you bring a cool, trusted friend with you. Preferably another introvert, b/c it's annoying to go to concerts with extraverts that are going to try to "get you out of your shell."
I will tell you that asking the drunk dudes behind you to stop whatever annoying thing they're doing will result in them doing it more/louder for the rest of the concert. :-)
Go, and have fun!