You are not alone. Yes, the places that you mention are nightmares for me, too. I actually went to every free hearing test that was offered because I thought that I was going deaf. But the hearing tests are given in quiet environments and my hearing is actually better than normal.
When I'm trying to concentrate, I listen to music. I can't concentrate if someone is singing. I need instrumental music for that.
I don't know if it's just an ISFP thing but I kind of suspect that other types may experience this, too.