This is interesting, as I understand it this pertains to usury, which technically may not be the same as interest and I believe in many of its articulations in scriptures states that usury can not be exercised with members of the community of believers but may be exercised with strangers, foreigners or non-faith, although this may be a case of technicalities and choosing to discover a way of "bending the rules", it just depends on how literal you decide to interpret the faith.
I do know some Christians who would never work in finance, of any description, because they believe that the actions of Jesus expelling money changers from the Temple say it all, they also literally interpret rules against usury as prohibiting all forms of interest charges.
I do not know enough about the emergence of finance in the west, I think the Borgia had a lot to do with it and they were pretty corrupt and ruthless people who virtually hijacked the Roman Catholic Papacy and took it for their own personal property and form of absolutist rule, there is however an excellent chapter in the novel Jack Faust, which is a modern retelling of the story of Faust, in which the central protagonist is called before a secret German tribunal at one point and he explains to them how they can circumvent the rules regarding usury as at that time in Christendom it was prohibited too.
The role of finance capital in the scriptures of the big three is always suspect, I think I recall some assertion that people should only earn their money by direct tradesmanship rather than finance and it relates to other ideas which later socialists, like Proudhon in France, took up about how to resolve the issue of money having an intrinsic value all of its own as opposed to possessing only a use or exchange value. In the fictional universe of 40K the Orcs have a society entirely without inflation because their currency is teeth but the teeth decay and disappear, therefore no one hoards money, saves money and the society is devoid of finance in any traditional sense, its portrayed as richer for it.
Most of the justification for finance which make sense to me however regard the ready availability of money as loans for enterprise, the firms making the loans can earn a living from interest as the rewards in the economy reflect the risks people are willing to make, in this paradigm risk aversion is worse than the possibility of usury as risk aversion will cause the economy to come to a grinding halt, prevent cycles of creative destruction or price corrections.