I definitely agree with the idea that "artsy" does not mean artistic talent. It's more of an attitude you exude & a way of looking at the world. You may not have any talent, but you appreciate art, or see things from an artistic angle.
I think non-creative INFPs would be a lot more unusual than non-artsy ones too. My mom told me once she can't imagine me in a job that is not creative, but she didn't say "artistic". I would agree with her; I don't need to be making art, and frankly I'm probably a mediocre artist anyway, but I do need to be creative. You can be creative in almost anything, but some jobs are more conducive to it than others. Outside of work (which more often than not, is just a way to make a living), most INFPs seem to have some area they are creative in, even if just in the sense that they have an original, imaginative approach.