Remember that when you do favors for people, you should not expect anything in return. To expect favors in return is not healthy -- they're favors after all, right? If you do a favor for somebody and they don't return the favor, and then you punish them in some way for it, that's passive-aggressive manipulation. Not healthy.
These days I will only do big favors for close friends and family. I DO return favors for favors, but that is my choice, my standard to live by, and I don't expect anything more of it.