I just get a couple of kids, one a neighbor kid, and one a kid from school, that like to come over. Both are special needs - one mentally retarded and one very extroverted Aspie.
The neighbor kid with mental retardation will just come sit on our porch for, like, twenty minutes. He's in high school, but he is about the same maturity level as my autistic 11 year old and he likes to play with toy guns. He can be kind of mean and doesn't listen very well when he's told something, so I have mixed feelings about them playing together.
The Aspie rides his bike, like, a mile or so to get to our house. He does it in all kinds of weather and if I let him, he will stay after dark. He isn't mean, per se, but he can have a temper (I've never seen it at my house, but the kids at school like to get him going). He has to have attention and he talks loud. He tries to be polite, but he doesn't listen very well and does not know when to quit. You have to be very explicit and/or rude to get a point across.
I wish their parents would not let them just run like they do or would work with them a bit more on the social cues, etc. It's frustrating because I already have four of my own kids (two of whom have autism) and a foreign exchange student to look after. I am not the local special needs after school center. It puts me in a position to have to be mean to their kids and I don't want to be, I just want to be left alone most of the time.
Edit: As for other folks, I don't have too many friends or go out of my way to make them. My friends know that if it isn't a good time to talk, etc I just don't answer the phone and I've gotten a lot better about saying no if I can't do something.