I never enjoyed math very much until I learned programming, after which I found it a useful tool with which to construct programs. By itself I found it too detail oriented and repetitive. I hear this is primarily true of the lower maths though, and that beyond the level of calculus it's much different.
Science is another story though. I'm a Biology major (hopefully eventually specializing in neuroscience).
On a related note, I have an INTJ brother who dropped out of Physics to major in Photography or Philosophy.