Or most utilities have local pay centers where you can pay cash for a small fee (usually under $2) and have it almost immediately credited to your account. Usually you have to go to a grocery store office, a bank, or -- around here -- a convenience store/gas station.
There are more rip-offy ways to do it, like using Western Union. Thankfully I've had very little experience with that.
And the pre-paid cards of course, but my experience with them has been more of the rip-offy variety. I may just not know how to do it right, though.
Not a criminal and we've not had any garnishments or anything (hopefully never will) but I'm pretty awful at keeping track of money and when you live paycheck to paycheck you can get in the hole with a bank pretty deep pretty fast.