Odd. I've never heard people say it's not a religion.
(Although they usually also say it's just the truth as well.)
However, in your favor: There's a growing movement of recasting believers as "disciples" rather than "Christians." I guess they feel it gives them more validity and makes them sound less "religious" and more "spiritual."