Sounds about right. Just make sure you don't generalise your experience to the rest of humanity and keep an open mind about the people you meet to avoid making that mistake. It's a really easy trap to fall into and part of our self-preservation system (you see the same in other animals, dogs scared of fireworks who generalise it to include car backfires, for instance, and spend the rest of the year just as terrified as on the 4th of july and New Years). Otherwise you're in for a really angry, isolated and lonely life which would be a shame.
For that matter, those other people can also help you see your family in a different perspective and might give you a way to actually deal with them in a way that won't completely hurt/enrage you which you might want to take advantage of in a few years - or not, that's your call.