There are some professions that if you don't have a passion for it, you are not going to do it particularly well.
With that said, once you get good, passion can wane, and you can float into a 9-5 job that pays well and gives you plenty of family time and time for hobbies. That route was open to me, but I chose instead to seek something else I might be passionate about. I don't see anything wrong with either decision.
In addition, I think searching for "the perfect job" is not going to be that good either. Master something you enjoy and believe has a purpose and you can use that to move in different directions using what you've learned. My research adviser recently told me he believed I could do anything with my background because I've already mastered something. (not in those exact words)