Actually I am a physicist, which means I have studied a fair bit of math, but always with the goal or applying it to something. Like [MENTION=7]Totenkindly[/MENTION], I think I would find studying math alone to be too abstract, though it can be fun in a sort of puzzle-solving way. Teaching math as memorizing formulas and plugging in numbers is like teaching English as just spelling and grammar. Yes, you need to be able to plug in the numbers and to a calculation correctly, but "real" math is about figuring out what the formula is to begin with, based on what you are trying to do.
I suppose explaining it like this ("what you are trying to do") betrays the applied nature of my own math background. In any case, math is sometimes called the language of science, meaning that we describe (model, simulate, analyze) physical phenomena as much using mathematical expressions as using words and paragraphs. Learning math on its own is like learning a language. To me, at least, the interesting part is when you then use that language to read and discuss literature, or to write essays, poems, short stories, etc. I use math, then, to help me design experiments, to analyze the data I get from them, to use that to model the phenomenon I am studying in order to try to predict what will happen if I change this or that parameter. This process is iterative.
There is variety in math. You will find that algebra is different from geometry, and trig is related to both but different still. Then there is calculus (differential and integral), differential equations, and linear algebra (my favorite), which are also different. If you enjoy math but are concerned that it might be too boring or abstract, you might try taking basic physics or even chemistry. Then you will have something to apply it toward. If you aim to continue in any science or engineering subject, these courses might count toward your degree. I suggest you also speak with some of the TA's in your math courses. They will have studied lots of math, and can give you additional perspective on the different topics within the subject.
Good luck! I am always encouraged to see someone take an interest in math, or science.