Could say:So, how do I respond to the above? Mostly I ignore it, because frankly, it's not worth the bother of trying to explain it because all it comes across as is some kind of excuse. And I try NOT to let it bother me, but sometimes, the lack of what I consider an appropriate social response is hurtful and annoying.
I NEED THE BEST COMEBACK LINES HERE PEOPLE! HELP ME!
"Well then, you're lucky and sounds like you don't need that many. Haha. Be sure and let the dog out when you get here. I'll be leaving the key with the neighbors. See you after getting up!"
(Taking advantage of the assumption and reverse the relative understanding of what 'lucky' means.)
If I decided to say something like this, I'd be sure I did it jokingly with fun intended. Not trying to be mean.